-- Logs begin at Mon 2022-07-18 13:27:29 UTC, end at Mon 2022-07-18 14:34:12 UTC. -- Jul 18 13:53:07.763996 dv-cinder-849846-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 13:53:07.771872 dv-cinder-849846-1-smb devstack@keystone.service[80127]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 13:53:07 2022] *** Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: nodename: dv-cinder-849846-1-smb Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: machine: x86_64 Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: clock source: unix Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: pcre jit disabled Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: detected number of CPU cores: 4 Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: current working directory: / Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: detected binary path: /usr/bin/uwsgi-core Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: your processes number limit is 47680 Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: your memory page size is 4096 bytes Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: detected max file descriptor number: 2048 Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: lock engine: pthread robust mutexes Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: thunder lock: enabled Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 13:53:07.776211 dv-cinder-849846-1-smb devstack@keystone.service[80127]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 13:53:07.815277 dv-cinder-849846-1-smb devstack@keystone.service[80127]: Python main interpreter initialized at 0x56418fa609c0 Jul 18 13:53:07.815277 dv-cinder-849846-1-smb devstack@keystone.service[80127]: python threads support enabled Jul 18 13:53:07.815277 dv-cinder-849846-1-smb devstack@keystone.service[80127]: your server socket listen backlog is limited to 100 connections Jul 18 13:53:07.815277 dv-cinder-849846-1-smb devstack@keystone.service[80127]: your mercy for graceful operations on workers is 90 seconds Jul 18 13:53:07.815646 dv-cinder-849846-1-smb devstack@keystone.service[80127]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 13:53:07.815721 dv-cinder-849846-1-smb devstack@keystone.service[80127]: *** Operational MODE: preforking *** Jul 18 13:53:07.815977 dv-cinder-849846-1-smb devstack@keystone.service[80127]: *** uWSGI is running in multiple interpreter mode *** Jul 18 13:53:07.815977 dv-cinder-849846-1-smb devstack@keystone.service[80127]: spawned uWSGI master process (pid: 80127) Jul 18 13:53:07.816181 dv-cinder-849846-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 13:53:07.821806 dv-cinder-849846-1-smb devstack@keystone.service[80127]: spawned uWSGI worker 1 (pid: 80134, cores: 1) Jul 18 13:53:07.821806 dv-cinder-849846-1-smb devstack@keystone.service[80127]: spawned uWSGI worker 2 (pid: 80135, cores: 1) Jul 18 13:53:07.821806 dv-cinder-849846-1-smb devstack@keystone.service[80127]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 13:53:13.254046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:53:13.254046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: from cryptography.utils import int_from_bytes Jul 18 13:53:13.254861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:53:13.254861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: from cryptography.utils import int_from_bytes Jul 18 13:53:13.255124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:53:13.255124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jul 18 13:53:13.255563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 13:53:13.255563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: from cryptography.utils import int_from_bytes Jul 18 13:53:13.304043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 13:53:13.304223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 13:53:13.304415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] command line args: [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 13:53:13.304506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 13:53:13.304680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 13:53:13.304765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 13:53:13.304844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ================================================================================ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 13:53:13.304920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] command line args: [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 13:53:13.305093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] admin_token = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.305177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 13:53:13.305301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ================================================================================ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 13:53:13.305408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config_dir = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.305530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.305608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.305711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] config_source = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.305811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_dir = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.305894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] debug = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] config_source = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] debug = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.306988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_config_append = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_dir = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.307991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_config_append = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_dir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.308947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.309875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.310573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.310688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.310809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.310896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.311834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] publish_errors = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.312984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] publish_errors = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] standard_threads = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.313885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] standard_threads = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_journal = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_json = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.314991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_stderr = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.315085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] use_syslog = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.315159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_journal = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.315261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_json = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.315345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.315439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_stderr = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.315550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.315632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] use_syslog = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.315784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.315859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 13:53:13.316038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.316999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.317081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.317256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.317330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.317533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.317617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.317774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.317857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.318998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.319957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.320919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.321983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.322915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.323879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.324851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.325009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.325090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.325246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.325432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.325514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.325642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.325795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.326945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.327996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.328152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.328340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.328424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.328591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.328668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.328846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.328920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.329084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.329177 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.329324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.329423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.329837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.329906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.330905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.331960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.332887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.333998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.334119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.334235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.334356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.334527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.334748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.334860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.334981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.335926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.336926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.337953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.338918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.339910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.340992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.external = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.external = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.341990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.password = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] auth.token = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.password = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.342965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] auth.token = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.343909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344142 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.344963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.345079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.345194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.345317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.345486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.345683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.345803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.345918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.346978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.347889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.348801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.349960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.350910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.351937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.352989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.353957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.354895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.355964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.356081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.356198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.356313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.356429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.356544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.356669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.357281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.357507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.357632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.357749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.357865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.358947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.359913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.360963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.361923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.362992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.363931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.364882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.365894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.366942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.367999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.368933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.369882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.370971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.371892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.372008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.372131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.372248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.372365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.372534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.373165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.373283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.373457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.373579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.373696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.373811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.373956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.374913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.375907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.376959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.377912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.378962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.379909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380498 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.380967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381208 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.381949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.382894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.383953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.384890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.385948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.386895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.387946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388345 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.388952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.389903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.390962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.391898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.392957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 13:53:13.393074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 13:53:13.393074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 13:53:13.423322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.423546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.423652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.423772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.423855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.424003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.432126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.432381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.460572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.460795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.461209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.461476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.604418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.604671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.655402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.655685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.657067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.657303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.722259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.722483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.722708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.722930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.723039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.723152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.723234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.723369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.723453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.723636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.723854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.724067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.749953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.750047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.750166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.750247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.750379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.750460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.750595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.762310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.762442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.775383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.775503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.775613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.775719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.775835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.775919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776136 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80134) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.776740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80135) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 13:53:13.795383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.795580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 13:53:13.795740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.795911 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.795994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 13:53:13.796108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 13:53:13.796272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.796353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.796478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 13:53:13.796613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.796753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.796864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.797014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.797094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.797272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.797553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.808199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.808471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.808681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.808764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.808957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.809052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.809227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.809541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.817603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.818202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.820853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.821127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.821432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.821516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.821786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.821867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.822068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.822151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.822449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.822530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.822719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.822915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.823952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.824078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.824266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.851355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.852243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.852955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.853231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.853899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.854178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.859066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.859292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.859567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.860200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.860478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.860760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.866965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.867243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.868140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.868420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.871832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.872119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.872411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.872734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.873006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.873275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.873428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.873555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.873689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.873817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.873944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.874135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.874413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.874690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.874962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.875234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.892960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.893231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.894790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.895069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.897821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.899626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.901598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.901889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.903336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.903631 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.906962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.908734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.910613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.912395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.914367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.914661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.914951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.915243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.915523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.915802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.916193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.916490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.916773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.917056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.917376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.917654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.936060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.936424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.936691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.936959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.937868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.938244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.938516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.938784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.944999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.946728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.946944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.947072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.948488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.948761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.950011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.950295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.950618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.950935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.951378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.951977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.952258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.952540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.952834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.953105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.965386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.965658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.965933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.966237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.966640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.966927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.967197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.967324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.967509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.967788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.968063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.968341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.968615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.968886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.986951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.988823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.990232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.992147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.993552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.995156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.995509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.996780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:13.997054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.997181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.997329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:13.999798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:14.000075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.000351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.005561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.007146 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:14.007862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.009509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:14.010455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.010738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.011015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.011289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.012839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.013309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.013627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.013904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.020848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:14.021131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.021438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.023198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:14.023485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.023765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.029566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80134) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:14.029841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.030115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.030386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.030662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.030946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.031215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.031476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.031737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.031874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80135) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 13:53:14.032005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.032132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.032270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.032397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.032532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.032660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.032796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.032933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.033105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80134) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.033231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.033420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.033682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.033955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.034340 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.034845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.035220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.035488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.035788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80135) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 13:53:14.072036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56418fa609c0 pid: 80134 (default app) Jul 18 13:53:14.075373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116839-f9e8-458e-9822-a673f7858472 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:14.075784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116839-f9e8-458e-9822-a673f7858472 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:14.076069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c116839-f9e8-458e-9822-a673f7858472 None None] PATH_INFO: `/v3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:14.076252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56418fa609c0 pid: 80135 (default app) Jul 18 13:53:14.080805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Mon Jul 18 13:53:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:21.851113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3b81-dc75-448f-90fd-33a8d5e85b0e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:21.851684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3b81-dc75-448f-90fd-33a8d5e85b0e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:21.851684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf3b81-dc75-448f-90fd-33a8d5e85b0e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:21.855939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1/2] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:53:21.862088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:21.862523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:21.862523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:21.933006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: INFO dbcounter [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] Registered counter for database keystone Jul 18 13:53:21.955062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG oslo_db.sqlalchemy.engines [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:53:21.961297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writer thread running {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:53:22.142240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG passlib.handlers.bcrypt [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80134) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 13:53:22.142577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG passlib.handlers.bcrypt [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80134) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 13:53:22.196210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:22.197839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:22.319219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 2/3] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 18 13:53:22.470778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3b81-dc75-448f-90fd-33a8d5e85b0e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:22.539808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: INFO dbcounter [None req-17bf3b81-dc75-448f-90fd-33a8d5e85b0e None None] Registered counter for database keystone Jul 18 13:53:22.558870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG oslo_db.sqlalchemy.engines [None req-17bf3b81-dc75-448f-90fd-33a8d5e85b0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 13:53:22.565801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writer thread running {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 13:53:22.682086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf3b81-dc75-448f-90fd-33a8d5e85b0e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:22.687049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbb9d0-a7e2-4e16-ae33-6134f873f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:22.687710 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb9d0-a7e2-4e16-ae33-6134f873f4af admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:22.687991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb9d0-a7e2-4e16-ae33-6134f873f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:22.688262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbb9d0-a7e2-4e16-ae33-6134f873f4af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:22.696427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbb9d0-a7e2-4e16-ae33-6134f873f4af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:22.748574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4fbb9d0-a7e2-4e16-ae33-6134f873f4af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 13:53:22.748940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fbb9d0-a7e2-4e16-ae33-6134f873f4af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:22.758766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 2/4] 10.222.0.76 () {58 vars in 1324 bytes} [Mon Jul 18 13:53:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 13:53:22.764819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:22.780388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e46c92-376d-4ea6-9bdb-5e5f68fde17d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:22.784857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba8328-ad7b-4b43-bb43-60717acc3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:22.786153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8328-ad7b-4b43-bb43-60717acc3e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:22.786447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8328-ad7b-4b43-bb43-60717acc3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:22.786725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba8328-ad7b-4b43-bb43-60717acc3e08 admin admin] PATH_INFO: `/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:22.788241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba8328-ad7b-4b43-bb43-60717acc3e08 admin admin] RBAC: Authorizing `identity:get_project(project_id=9a4af5872a8c47a1a7622f9d72a65eeb)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:22.845706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a2ba8328-ad7b-4b43-bb43-60717acc3e08 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 13:53:22.846049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba8328-ad7b-4b43-bb43-60717acc3e08 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:22.850738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 3/5] 10.222.0.76 () {56 vars in 1207 bytes} [Mon Jul 18 13:53:22 2022] GET /identity/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:24.860975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7016a-dae6-48fc-a1a7-2d64d9b772db None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:24.861594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7016a-dae6-48fc-a1a7-2d64d9b772db None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:24.861594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7016a-dae6-48fc-a1a7-2d64d9b772db None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:24.865851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 3/6] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:53:24.871672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7264-73f5-411b-aad7-38fdf75cf97b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:24.872130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7264-73f5-411b-aad7-38fdf75cf97b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:24.872355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7264-73f5-411b-aad7-38fdf75cf97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:24.890732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3b4a7264-73f5-411b-aad7-38fdf75cf97b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:24.892227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3b4a7264-73f5-411b-aad7-38fdf75cf97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:24.900041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 4/7] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 13:53:24.923248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7016a-dae6-48fc-a1a7-2d64d9b772db None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:24.935389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7016a-dae6-48fc-a1a7-2d64d9b772db None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:24.939699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a688f-ab9c-40a6-9321-c78c5cbb1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:24.940335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a688f-ab9c-40a6-9321-c78c5cbb1c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:24.940623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a688f-ab9c-40a6-9321-c78c5cbb1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:24.940903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a688f-ab9c-40a6-9321-c78c5cbb1c06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:24.948651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a688f-ab9c-40a6-9321-c78c5cbb1c06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:24.950655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a688f-ab9c-40a6-9321-c78c5cbb1c06 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:24.959738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 4/8] 10.222.0.76 () {58 vars in 1324 bytes} [Mon Jul 18 13:53:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 13:53:24.965097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a7264-73f5-411b-aad7-38fdf75cf97b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:24.974706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a7264-73f5-411b-aad7-38fdf75cf97b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:24.979077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07bd16-7256-4799-bd15-5bc9db783c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:24.979930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07bd16-7256-4799-bd15-5bc9db783c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:24.980211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07bd16-7256-4799-bd15-5bc9db783c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:24.980486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07bd16-7256-4799-bd15-5bc9db783c23 admin admin] PATH_INFO: `/v3/users/fb50bdfd467346e58d39bc41efeb3f72` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:24.982114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07bd16-7256-4799-bd15-5bc9db783c23 admin admin] RBAC: Authorizing `identity:get_user(user_id=fb50bdfd467346e58d39bc41efeb3f72)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:24.983925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07bd16-7256-4799-bd15-5bc9db783c23 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:24.985527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 5/9] 10.222.0.76 () {56 vars in 1198 bytes} [Mon Jul 18 13:53:24 2022] GET /identity/v3/users/fb50bdfd467346e58d39bc41efeb3f72 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:27.078916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a9d7-3b06-4c09-8ba8-6d117096858c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.079702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a9d7-3b06-4c09-8ba8-6d117096858c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.079801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a9d7-3b06-4c09-8ba8-6d117096858c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.081259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 5/10] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:27.086675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470be27-cd9c-4090-9a36-b883187cc7be None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.087108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470be27-cd9c-4090-9a36-b883187cc7be None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.087291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470be27-cd9c-4090-9a36-b883187cc7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.101408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6143-95d0-4fd1-87ca-c66a60e5dd06 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.101776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6143-95d0-4fd1-87ca-c66a60e5dd06 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.102061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c6143-95d0-4fd1-87ca-c66a60e5dd06 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.103636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 6/11] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:53:27.104387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f470be27-cd9c-4090-9a36-b883187cc7be None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:27.105619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f470be27-cd9c-4090-9a36-b883187cc7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:27.108628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.108916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.109222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.152542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80135) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 13:53:27.152960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG passlib.handlers.bcrypt [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80135) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 13:53:27.189512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 6/12] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:27.198486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:27.200919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:27.212880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470be27-cd9c-4090-9a36-b883187cc7be None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.237506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:27.301996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 7/13] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:27.319424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470be27-cd9c-4090-9a36-b883187cc7be None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:27.324318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.354010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:27.354730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.355015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.355294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.366959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:27.379236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:27.380328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:27.381383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 7/14] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:53:27.386287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.429715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deb5fe-0006-4a29-b604-9cc6633ae241 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:27.433108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:27.470776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:27.471671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.471958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.472086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:27.472235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.490834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596362ad-68e3-4733-99e1-360566ae1a5f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:27.527285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:27.527955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.528351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.528864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.529741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:27.530099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:27.532195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:27.549300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:27.555514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 8/15] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:27.555667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:27.556624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.667979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 8/16] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 13:53:27.673678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.676766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:27.679374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17c12d-1a3b-400a-9873-ae4e6f1b2f4f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:27.727877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:27.728828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.729104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.729462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] PATH_INFO: `/v3/users/fb50bdfd467346e58d39bc41efeb3f72` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.730730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=fb50bdfd467346e58d39bc41efeb3f72)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:27.732274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:27.733949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 9/17] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/users/fb50bdfd467346e58d39bc41efeb3f72 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:27.739256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.756264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:27.791427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3075d-b42c-4918-a92b-a6b7a3e72e18 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:27.833517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:27.834710 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.835001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.835283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.863758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffd207-7ecc-4d53-aaa5-e0d26644fcf7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:27.864218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:27.865762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:53:27.895512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:27.896465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:27.897248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:53:27.897248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:53:27.897248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:53:27.897248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:27.897248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 9/18] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:53:27.902829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:27.903526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.904132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:27.904651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:27.905164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:27.907297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:27.909249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:27.910949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 10/19] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:27.916594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:27.970313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:28.016074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:28.027000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad48e2e-5ceb-4fac-8292-731c03766d9a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:28.038553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd145f-2d03-4346-b20e-b01f2b404830 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:28.073554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21847e8-7eb0-4863-930b-3873d7e4a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:28.074166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21847e8-7eb0-4863-930b-3873d7e4a136 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:28.074451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21847e8-7eb0-4863-930b-3873d7e4a136 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:28.074732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21847e8-7eb0-4863-930b-3873d7e4a136 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:28.077917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21847e8-7eb0-4863-930b-3873d7e4a136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:28.077917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21847e8-7eb0-4863-930b-3873d7e4a136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:28.077917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21847e8-7eb0-4863-930b-3873d7e4a136 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:28.080142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc859b94-5e78-40ae-8db2-c48d6548cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:28.080810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc859b94-5e78-40ae-8db2-c48d6548cd43 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:28.081089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc859b94-5e78-40ae-8db2-c48d6548cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:28.081383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc859b94-5e78-40ae-8db2-c48d6548cd43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:28.082227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc859b94-5e78-40ae-8db2-c48d6548cd43 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.domain.id=default, user.id=fb50bdfd467346e58d39bc41efeb3f72) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:28.082537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc859b94-5e78-40ae-8db2-c48d6548cd43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:28.085549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc859b94-5e78-40ae-8db2-c48d6548cd43 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:28.093564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 11/20] 10.222.0.76 () {56 vars in 1322 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/role_assignments?user.id=fb50bdfd467346e58d39bc41efeb3f72&scope.domain.id=default&role.id=12c8bb015e454a52a54bf61032d11091 => generated 233 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:28.098498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 10/21] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:30.515200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c558eb-386f-42c2-ae9b-ba1998bd7564 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:30.515671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c558eb-386f-42c2-ae9b-ba1998bd7564 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:30.515671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c558eb-386f-42c2-ae9b-ba1998bd7564 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:30.517276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 12/22] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:30.535561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34de25-51bd-474d-9d31-67de2e86dcd5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:30.536467 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34de25-51bd-474d-9d31-67de2e86dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:30.536956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34de25-51bd-474d-9d31-67de2e86dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:30.562407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fd34de25-51bd-474d-9d31-67de2e86dcd5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:30.563959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fd34de25-51bd-474d-9d31-67de2e86dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:30.649880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 11/23] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:30.685450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c558eb-386f-42c2-ae9b-ba1998bd7564 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:30.814868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c558eb-386f-42c2-ae9b-ba1998bd7564 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:30.870109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f829ea-656c-43ea-b125-09dacbde2f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:30.870932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f829ea-656c-43ea-b125-09dacbde2f5c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:30.871219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f829ea-656c-43ea-b125-09dacbde2f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:30.871495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f829ea-656c-43ea-b125-09dacbde2f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:30.886226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f829ea-656c-43ea-b125-09dacbde2f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-92f829ea-656c-43ea-b125-09dacbde2f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:30.894511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:30.895439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:30.896428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 13/24] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:30.901696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34de25-51bd-474d-9d31-67de2e86dcd5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:30.977705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:30.986967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6de01-58be-422c-9bb6-9be44909a1fb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:30.987256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6de01-58be-422c-9bb6-9be44909a1fb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:30.987536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6de01-58be-422c-9bb6-9be44909a1fb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:30.988928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 14/25] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:53:30.994788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95401bfb-c4be-4249-9561-349d9f9e69b3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:30.995076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95401bfb-c4be-4249-9561-349d9f9e69b3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:30.995357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95401bfb-c4be-4249-9561-349d9f9e69b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.018352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:31.029503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-95401bfb-c4be-4249-9561-349d9f9e69b3 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:31.030850 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-95401bfb-c4be-4249-9561-349d9f9e69b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:31.074294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34de25-51bd-474d-9d31-67de2e86dcd5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:31.147201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 15/26] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:31.151576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caceb2-3e73-43d5-a285-6e90c7fc752b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.152001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caceb2-3e73-43d5-a285-6e90c7fc752b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.152387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caceb2-3e73-43d5-a285-6e90c7fc752b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.156692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 16/27] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:31.164883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc330ca-47af-4384-9af5-5e08768f52a9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.165210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc330ca-47af-4384-9af5-5e08768f52a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.165515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc330ca-47af-4384-9af5-5e08768f52a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.166235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:31.166962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.167417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.167889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.169077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:31.169413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:31.171143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:31.202155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 12/28] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:31.203008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:31.204726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4bc330ca-47af-4384-9af5-5e08768f52a9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:31.205956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4bc330ca-47af-4384-9af5-5e08768f52a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:31.297413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 17/29] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:31.298599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc330ca-47af-4384-9af5-5e08768f52a9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:31.342065 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a15aa4-7257-4318-bed2-039bd1223581 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:31.361751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:31.382295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:31.393489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260066a-257d-46d9-8d33-8f8560145853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:31.394300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260066a-257d-46d9-8d33-8f8560145853 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.394584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260066a-257d-46d9-8d33-8f8560145853 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.394857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260066a-257d-46d9-8d33-8f8560145853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.409057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260066a-257d-46d9-8d33-8f8560145853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:31.410582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260066a-257d-46d9-8d33-8f8560145853 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:31.424923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc330ca-47af-4384-9af5-5e08768f52a9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b260066a-257d-46d9-8d33-8f8560145853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:53:31.436154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:31.436958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:31.437778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:53:31.437778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:53:31.437778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:53:31.437778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:31.438006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 13/30] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:31.442979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8069b3-5821-4e8d-ab1b-67040d52829b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.443412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8069b3-5821-4e8d-ab1b-67040d52829b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.443703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8069b3-5821-4e8d-ab1b-67040d52829b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.445065 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 14/31] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:31.445825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8069b3-5821-4e8d-ab1b-67040d52829b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:31.479651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:31.480841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.482007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.482287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] PATH_INFO: `/v3/users/fb50bdfd467346e58d39bc41efeb3f72` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.483671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] RBAC: Authorizing `identity:get_user(user_id=fb50bdfd467346e58d39bc41efeb3f72)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:31.486056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:31.487951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 18/32] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:31 2022] GET /identity/v3/users/fb50bdfd467346e58d39bc41efeb3f72 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:31.488895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:31.560248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8069b3-5821-4e8d-ab1b-67040d52829b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:31.596834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:31.597452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.597739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.598019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.598787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:31.600191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:31.614213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505818f7-7200-498f-a458-3dcd1dfb2606 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:31.648712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:31.655641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd5143-393c-4e80-a0f4-3eacf8d674ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:31.656362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd5143-393c-4e80-a0f4-3eacf8d674ef None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.656648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd5143-393c-4e80-a0f4-3eacf8d674ef None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.656928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd5143-393c-4e80-a0f4-3eacf8d674ef None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.657694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd5143-393c-4e80-a0f4-3eacf8d674ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:31.658004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd5143-393c-4e80-a0f4-3eacf8d674ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:31.659376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd5143-393c-4e80-a0f4-3eacf8d674ef None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:31.684779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 19/33] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:31.684779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b7fdc-1090-478a-8d0b-9ef6c287a11d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.684779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b7fdc-1090-478a-8d0b-9ef6c287a11d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.684779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b7fdc-1090-478a-8d0b-9ef6c287a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.701190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1e9b7fdc-1090-478a-8d0b-9ef6c287a11d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:31.702462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e9b7fdc-1090-478a-8d0b-9ef6c287a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:31.738923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 15/34] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 13:53:31 2022] POST /identity/v3/roles => generated 225 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:31.739992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:31.765494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:31.798039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 20/35] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:31.798039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9e86e-5d59-40fa-8464-c66a6f0558cc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.798039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9e86e-5d59-40fa-8464-c66a6f0558cc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.798039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9e86e-5d59-40fa-8464-c66a6f0558cc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.798039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 21/36] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:31.807700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9e86e-5d59-40fa-8464-c66a6f0558cc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:31.895542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be8d0a-f0bb-46af-ae93-73f9df511692 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:31.940513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9e86e-5d59-40fa-8464-c66a6f0558cc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:31.944183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88230452-5213-4044-b055-09161b9c8497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:31.945009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230452-5213-4044-b055-09161b9c8497 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.945369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230452-5213-4044-b055-09161b9c8497 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.945688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88230452-5213-4044-b055-09161b9c8497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.947263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88230452-5213-4044-b055-09161b9c8497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:31.949291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88230452-5213-4044-b055-09161b9c8497 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:31.955264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 16/37] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:31.955264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc54d-2b4e-45d5-82f0-9cfd2fc76573 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.955264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc54d-2b4e-45d5-82f0-9cfd2fc76573 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.955264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afc54d-2b4e-45d5-82f0-9cfd2fc76573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.967465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:31.977680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e4afc54d-2b4e-45d5-82f0-9cfd2fc76573 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:31.979555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e4afc54d-2b4e-45d5-82f0-9cfd2fc76573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:31.988649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:31.989741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:31.990650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:31.991138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:31.992340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:31.994178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:32.056835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 17/38] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:32.057701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afc54d-2b4e-45d5-82f0-9cfd2fc76573 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:32.096961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:32.192909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afc54d-2b4e-45d5-82f0-9cfd2fc76573 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:32.230275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe657228-6223-4794-8336-703915f9d542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:32.230961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe657228-6223-4794-8336-703915f9d542 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:32.231865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe657228-6223-4794-8336-703915f9d542 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:32.232248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe657228-6223-4794-8336-703915f9d542 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:32.233015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe657228-6223-4794-8336-703915f9d542 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:32.234523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe657228-6223-4794-8336-703915f9d542 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:32.253392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 22/39] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:53:31 2022] POST /identity/v3/projects => generated 301 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:32.253629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 18/40] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 13:53:32 2022] POST /identity/v3/roles => generated 219 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:32.253706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:32.253773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe657228-6223-4794-8336-703915f9d542 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:32.392778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:32.413824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd8a29-ac00-4a70-8e21-fa55b3180800 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:32.430287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe657228-6223-4794-8336-703915f9d542 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:32.464225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99345ccd-c58a-4230-8b96-5fc9510403ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:32.465333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345ccd-c58a-4230-8b96-5fc9510403ba None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:32.466304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345ccd-c58a-4230-8b96-5fc9510403ba None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:32.466721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99345ccd-c58a-4230-8b96-5fc9510403ba None admin] PATH_INFO: `/v3/domains/default/users/fb50bdfd467346e58d39bc41efeb3f72/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:32.469616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99345ccd-c58a-4230-8b96-5fc9510403ba None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fb50bdfd467346e58d39bc41efeb3f72, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:32.471561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99345ccd-c58a-4230-8b96-5fc9510403ba None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:32.473240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:32.473988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:32.474271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:32.474549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:32.475300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:32.476663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:32.492404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 23/41] 10.222.0.76 () {58 vars in 1361 bytes} [Mon Jul 18 13:53:32 2022] PUT /identity/v3/domains/default/users/fb50bdfd467346e58d39bc41efeb3f72/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:53:32.494230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160c29-59ff-4b82-8ceb-a1007fa52277 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:32.494554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160c29-59ff-4b82-8ceb-a1007fa52277 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:32.494792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea160c29-59ff-4b82-8ceb-a1007fa52277 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:32.496499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 24/42] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:32.496614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 19/43] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 13:53:32 2022] POST /identity/v3/roles => generated 223 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:32.502925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99eea-44e8-480e-b9e2-d1471cd055cb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:32.503291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99eea-44e8-480e-b9e2-d1471cd055cb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:32.503575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed99eea-44e8-480e-b9e2-d1471cd055cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:32.525541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-aed99eea-44e8-480e-b9e2-d1471cd055cb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:32.527095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-aed99eea-44e8-480e-b9e2-d1471cd055cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:32.564251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:32.617130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 25/44] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:32.640335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:32.760657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f51b-73e0-441c-99ab-30ef6c7830fd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:32.796127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f2b1b-4eae-4cda-b9da-2a12a69d0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:32.796929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2b1b-4eae-4cda-b9da-2a12a69d0d23 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:32.797217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2b1b-4eae-4cda-b9da-2a12a69d0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:32.797531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f2b1b-4eae-4cda-b9da-2a12a69d0d23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:32.798709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f2b1b-4eae-4cda-b9da-2a12a69d0d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:32.800181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f2b1b-4eae-4cda-b9da-2a12a69d0d23 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:32.801856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 20/45] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:32.807414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed99eea-44e8-480e-b9e2-d1471cd055cb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:32.909715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed99eea-44e8-480e-b9e2-d1471cd055cb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:32.946009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb29014-e85b-454c-9f2b-891c00834c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:32.946674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29014-e85b-454c-9f2b-891c00834c93 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:32.946989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29014-e85b-454c-9f2b-891c00834c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:32.947270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29014-e85b-454c-9f2b-891c00834c93 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:32.947994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb29014-e85b-454c-9f2b-891c00834c93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:32.949541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb29014-e85b-454c-9f2b-891c00834c93 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:32.976170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 26/46] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:53:32 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:34.543282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e076-ca96-4e0a-a335-1e79e30a7875 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:34.545370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e076-ca96-4e0a-a335-1e79e30a7875 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:34.545370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e076-ca96-4e0a-a335-1e79e30a7875 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:34.545962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 21/47] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:34.551099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e1f0-a591-413f-9cd8-fc035af39feb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:34.551493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e1f0-a591-413f-9cd8-fc035af39feb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:34.551657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96e1f0-a591-413f-9cd8-fc035af39feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:34.568205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cf96e1f0-a591-413f-9cd8-fc035af39feb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:34.569424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cf96e1f0-a591-413f-9cd8-fc035af39feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:34.580867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:34.646137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 27/48] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:34.669481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e076-ca96-4e0a-a335-1e79e30a7875 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:34.678846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:34.773906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e076-ca96-4e0a-a335-1e79e30a7875 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:34.811029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:34.811740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:34.812025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:34.812305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:34.823768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:34.832928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:34.833775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:34.834522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 22/49] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:53:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:34.840100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96e1f0-a591-413f-9cd8-fc035af39feb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:34.937723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96e1f0-a591-413f-9cd8-fc035af39feb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:34.980732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87880265-70a8-4b0c-90ce-e6a22e0a298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:34.982081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87880265-70a8-4b0c-90ce-e6a22e0a298f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:34.982362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87880265-70a8-4b0c-90ce-e6a22e0a298f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:34.982638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87880265-70a8-4b0c-90ce-e6a22e0a298f None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:34.983387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87880265-70a8-4b0c-90ce-e6a22e0a298f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:34.983693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87880265-70a8-4b0c-90ce-e6a22e0a298f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:34.985079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87880265-70a8-4b0c-90ce-e6a22e0a298f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:34.993354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 28/50] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:34.999693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:35.025676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9ef3b-9161-4665-adbc-fad6aa2ad20b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:35.025973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9ef3b-9161-4665-adbc-fad6aa2ad20b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:35.026260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9ef3b-9161-4665-adbc-fad6aa2ad20b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:35.027632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 29/51] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:53:35.032586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea2b90-1a6c-4773-b6c0-10ce3bc6fc73 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:35.032876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea2b90-1a6c-4773-b6c0-10ce3bc6fc73 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:35.033162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea2b90-1a6c-4773-b6c0-10ce3bc6fc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:35.049968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-57ea2b90-1a6c-4773-b6c0-10ce3bc6fc73 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:35.051275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-57ea2b90-1a6c-4773-b6c0-10ce3bc6fc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:35.053225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:35.066917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:35.106395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc164bd-c423-47ae-bb68-ed50c60910fe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:35.124421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 30/52] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:35.139924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:35.140803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:35.141087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:35.141391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] PATH_INFO: `/v3/users/fb50bdfd467346e58d39bc41efeb3f72` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:35.142819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] RBAC: Authorizing `identity:get_user(user_id=fb50bdfd467346e58d39bc41efeb3f72)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:35.144291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:35.146156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 23/53] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:34 2022] GET /identity/v3/users/fb50bdfd467346e58d39bc41efeb3f72 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:35.147066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea2b90-1a6c-4773-b6c0-10ce3bc6fc73 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:35.151245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:35.246840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea2b90-1a6c-4773-b6c0-10ce3bc6fc73 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:35.254612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9309-7f58-42b6-b5a9-7cbcfc6a290e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:35.280319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:35.281113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:35.281435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:35.281720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:35.282902 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:35.284387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:35.286053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 31/54] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:35.290346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:35.291285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:35.291575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:35.291666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:35.291854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:35.293055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:35.295443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:35.297060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 24/55] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:35.300742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:35.302665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:35.305560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:35.400142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5be4-bb65-4814-b4de-241da009faa2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:35.437167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b76a1-8157-4381-8f28-2cd533913813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:35.437861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b76a1-8157-4381-8f28-2cd533913813 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:35.438387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b76a1-8157-4381-8f28-2cd533913813 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:35.438509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b76a1-8157-4381-8f28-2cd533913813 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:35.439177 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b76a1-8157-4381-8f28-2cd533913813 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:35.440588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b76a1-8157-4381-8f28-2cd533913813 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:35.467400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 32/56] 10.222.0.76 () {60 vars in 1140 bytes} [Mon Jul 18 13:53:35 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:53:35.520963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbac5ff-0973-4241-8fd0-690509242f24 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:35.559249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e704c4e-0783-4f7d-a712-0342a89604e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:35.560168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e704c4e-0783-4f7d-a712-0342a89604e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:35.560370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e704c4e-0783-4f7d-a712-0342a89604e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:35.560658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e704c4e-0783-4f7d-a712-0342a89604e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:35.561548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e704c4e-0783-4f7d-a712-0342a89604e9 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.domain.id=default, user.id=fb50bdfd467346e58d39bc41efeb3f72) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:35.561870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e704c4e-0783-4f7d-a712-0342a89604e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:35.563360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e704c4e-0783-4f7d-a712-0342a89604e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:35.572830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 25/57] 10.222.0.76 () {56 vars in 1322 bytes} [Mon Jul 18 13:53:35 2022] GET /identity/v3/role_assignments?user.id=fb50bdfd467346e58d39bc41efeb3f72&scope.domain.id=default&role.id=12c8bb015e454a52a54bf61032d11091 => generated 530 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:37.540952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e67a6-81c2-4fd9-b43a-7ffb044c2692 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:37.541470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e67a6-81c2-4fd9-b43a-7ffb044c2692 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:37.541557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e67a6-81c2-4fd9-b43a-7ffb044c2692 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:37.542962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 33/58] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:37.548402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349228a-2cf3-4b3c-b800-41f44aaf3320 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:37.548773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349228a-2cf3-4b3c-b800-41f44aaf3320 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:37.548968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349228a-2cf3-4b3c-b800-41f44aaf3320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:37.566409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1349228a-2cf3-4b3c-b800-41f44aaf3320 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:37.567603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1349228a-2cf3-4b3c-b800-41f44aaf3320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:37.626498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:37.633923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 26/59] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:37.658392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e67a6-81c2-4fd9-b43a-7ffb044c2692 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:37.718771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:37.764119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e67a6-81c2-4fd9-b43a-7ffb044c2692 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:37.802964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c872c3e-0b45-4754-a9a8-17743b04e650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:37.803683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872c3e-0b45-4754-a9a8-17743b04e650 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:37.803970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872c3e-0b45-4754-a9a8-17743b04e650 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:37.804251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c872c3e-0b45-4754-a9a8-17743b04e650 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:37.805473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872c3e-0b45-4754-a9a8-17743b04e650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:37.806920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c872c3e-0b45-4754-a9a8-17743b04e650 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:37.808542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 34/60] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:37.815038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349228a-2cf3-4b3c-b800-41f44aaf3320 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:37.912485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349228a-2cf3-4b3c-b800-41f44aaf3320 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:37.946713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8794f-1afa-4ff3-9e61-bb64722bc8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:37.947382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8794f-1afa-4ff3-9e61-bb64722bc8e2 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:37.947669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8794f-1afa-4ff3-9e61-bb64722bc8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:37.947948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8794f-1afa-4ff3-9e61-bb64722bc8e2 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:37.948695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8794f-1afa-4ff3-9e61-bb64722bc8e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:37.950171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8794f-1afa-4ff3-9e61-bb64722bc8e2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:37.975634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 27/61] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:53:37 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:41.160090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321f9f-7aba-4221-9c1f-276bb0fb48d5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.161103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321f9f-7aba-4221-9c1f-276bb0fb48d5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.161616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0321f9f-7aba-4221-9c1f-276bb0fb48d5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.163480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 35/62] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:41.168968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160771c-0c37-4a49-be0b-967029f9d698 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.169780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160771c-0c37-4a49-be0b-967029f9d698 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.170287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160771c-0c37-4a49-be0b-967029f9d698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.190862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9160771c-0c37-4a49-be0b-967029f9d698 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:41.192369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9160771c-0c37-4a49-be0b-967029f9d698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:41.254200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d96aa-996c-43c1-a9bd-4cdc821b8318 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.254812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d96aa-996c-43c1-a9bd-4cdc821b8318 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.255310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d96aa-996c-43c1-a9bd-4cdc821b8318 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.257131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 36/63] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:41.260124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:41.266172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dcfe-6956-47be-8ee9-d336f57b3902 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.266677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dcfe-6956-47be-8ee9-d336f57b3902 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.267230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817dcfe-6956-47be-8ee9-d336f57b3902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.286500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 28/64] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:41.287835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6341c67-eff3-4a94-9215-96670bdf6a60 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.288128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6341c67-eff3-4a94-9215-96670bdf6a60 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.288411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6341c67-eff3-4a94-9215-96670bdf6a60 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.289990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 29/65] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:41.295488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d817dcfe-6956-47be-8ee9-d336f57b3902 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:41.296712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d817dcfe-6956-47be-8ee9-d336f57b3902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:41.307028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a29ce-8c94-456d-bfda-cd75f0e8d075 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.307322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a29ce-8c94-456d-bfda-cd75f0e8d075 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.307605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a29ce-8c94-456d-bfda-cd75f0e8d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.330177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3a6a29ce-8c94-456d-bfda-cd75f0e8d075 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:41.332092 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3a6a29ce-8c94-456d-bfda-cd75f0e8d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:41.383358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 37/66] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:41.384410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dcfe-6956-47be-8ee9-d336f57b3902 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:41.421385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 30/67] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:41.422480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a29ce-8c94-456d-bfda-cd75f0e8d075 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:41.474015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:41.528336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817dcfe-6956-47be-8ee9-d336f57b3902 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:41.565592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:41.565793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a29ce-8c94-456d-bfda-cd75f0e8d075 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:41.566746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.567173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.567592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.580073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:41.582014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:41.593545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:41.595410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:41.596373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:41.598495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 38/68] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:41.599502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:41.612156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:41.612991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.613280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.613595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.627110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:41.636614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:41.638051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:41.639371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 31/69] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:53:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:41.640823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:41.720348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe04d1-56a0-4f2a-b77d-1dd9fc73696d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:41.737882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:41.749934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c543d3-dfcc-404c-995d-bdaf21faa76d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:41.758861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44873c39-14bd-4285-9767-91dee36c2ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:41.759684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44873c39-14bd-4285-9767-91dee36c2ada None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.759975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44873c39-14bd-4285-9767-91dee36c2ada None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.760259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44873c39-14bd-4285-9767-91dee36c2ada None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.772181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44873c39-14bd-4285-9767-91dee36c2ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-44873c39-14bd-4285-9767-91dee36c2ada None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:41.780765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:41.781763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:41.782506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 39/70] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:53:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:41.783524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbd5e7-5b64-49da-adb5-728255556999 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.783524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbd5e7-5b64-49da-adb5-728255556999 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.783792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbd5e7-5b64-49da-adb5-728255556999 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.785222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 40/71] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:41.786110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbd5e7-5b64-49da-adb5-728255556999 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:41.792046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:41.792953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.794134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.794680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.795642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:41.796263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:41.797802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:41.807483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 32/72] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:41.808597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:41.848583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:41.903288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbd5e7-5b64-49da-adb5-728255556999 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:41.917902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300748f-15c3-4d08-a4b6-dc36a4836f20 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:41.938194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048df35-efa9-4006-babb-d0f04f83af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:41.938855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048df35-efa9-4006-babb-d0f04f83af1d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.939131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048df35-efa9-4006-babb-d0f04f83af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.939401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048df35-efa9-4006-babb-d0f04f83af1d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.940145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048df35-efa9-4006-babb-d0f04f83af1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:41.940445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048df35-efa9-4006-babb-d0f04f83af1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:41.941884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048df35-efa9-4006-babb-d0f04f83af1d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:41.950069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 41/73] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:41.951247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1289-7b80-4275-8bce-a5d98d197c4b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.951701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1289-7b80-4275-8bce-a5d98d197c4b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.951977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:41.952116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad1289-7b80-4275-8bce-a5d98d197c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.952657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:41.952949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:41.953232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:41.954385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:41.954796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:41.956188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:41.964590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 33/74] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:53:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:41.966145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:41.970610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b3ad1289-7b80-4275-8bce-a5d98d197c4b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:41.971817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b3ad1289-7b80-4275-8bce-a5d98d197c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:42.001008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.038569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 42/75] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:42.041027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfa5e6-ad18-4227-93d5-6d6750bc650d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.041327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfa5e6-ad18-4227-93d5-6d6750bc650d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.041645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfa5e6-ad18-4227-93d5-6d6750bc650d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.043118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 43/76] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:42.044631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfa5e6-ad18-4227-93d5-6d6750bc650d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.066586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.073171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3bcb4-c3f3-4443-8029-5a97bff004c8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.120732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.121692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.121974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.122251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.137806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:42.139332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:42.141043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 34/77] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:41 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:42.142011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.169254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfa5e6-ad18-4227-93d5-6d6750bc650d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.202349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d594d-2781-485c-9198-99064c45d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.203217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d594d-2781-485c-9198-99064c45d131 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.203503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d594d-2781-485c-9198-99064c45d131 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.203790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d594d-2781-485c-9198-99064c45d131 None admin] PATH_INFO: `/v3/users/fb50bdfd467346e58d39bc41efeb3f72` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.205243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d594d-2781-485c-9198-99064c45d131 None admin] RBAC: Authorizing `identity:get_user(user_id=fb50bdfd467346e58d39bc41efeb3f72)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:42.206730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d594d-2781-485c-9198-99064c45d131 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:42.208364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 44/78] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/users/fb50bdfd467346e58d39bc41efeb3f72 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:42.209538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c86d-f26e-49bc-acfe-57accd811353 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.209832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c86d-f26e-49bc-acfe-57accd811353 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.210118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c86d-f26e-49bc-acfe-57accd811353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.226594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4f84c86d-f26e-49bc-acfe-57accd811353 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:42.227792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4f84c86d-f26e-49bc-acfe-57accd811353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:42.245417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca97999-0020-45d5-9b14-660841119f47 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.257036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.279924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.280798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.281086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.281394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.282703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:42.284711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:42.286742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 35/79] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:42.287511 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.296898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 45/80] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:42.296898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c86d-f26e-49bc-acfe-57accd811353 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.314147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.390789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe970094-cb3f-49f5-a5eb-d868be64ea6e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.405822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c86d-f26e-49bc-acfe-57accd811353 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.426066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.426801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.427091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.427373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.438174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:42.440433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.441074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.441387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.441664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:42.445920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:42.446758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:42.447508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 36/81] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:42.449971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.476368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.510862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:42.512915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:42.531835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.550794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27525fd-57c5-4b2c-a93a-d7db15a9fdf3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.584997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.585676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.585973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.586254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.610728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 46/82] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:42.611646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.658528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:42.660006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:42.675708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.711283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7d2d4-6c1a-4a55-9bf6-8a80b7049380 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.743824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.744471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.744755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.744878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.745022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.764978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 37/83] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:42.765851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.817136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:42.818657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:42.867154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf9d6-aaf9-462f-b388-4945698c61ee None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:42.884018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:42.902525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:42.903408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:42.903695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:42.903973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:42.905146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:42.906605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:42.908487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 38/84] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:42.909071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.920647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 47/85] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:42.921550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:42.959138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:43.009206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50543971-9533-445c-aee6-217fb8b642fd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.021090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c202b7a-4270-484d-82aa-8fc825f82d3a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.044693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.045390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.045678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.045952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.046696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:43.047000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.048438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.056789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.056966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 39/86] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.057683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.057970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.058248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.060407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.061896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.062414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.068180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 48/87] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:42 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.068180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.100949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:43.162845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86ffa7-1360-4e90-9e7c-029044cb87a1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.166854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c9d6-bb9a-42ed-8cb6-aba5b2dc0697 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.176326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:43.197904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.198765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.199048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.199357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.200540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.201301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.202002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.202091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.202292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.202574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.203288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.203794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 40/88] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:43 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.204822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.204980 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.232499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 49/89] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:53:43 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:43.233450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.329463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5e9c5-2cbd-46b2-8dff-2c2af9df250c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.362629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:43.370294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.371228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.371595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.371942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.373332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.374868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.375276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00999d07-637b-44bc-bad4-63f5effd9be6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.376657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 41/90] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:43 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.377471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.432226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.433153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.433470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.434359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.435820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.437297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.438980 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 50/91] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:43 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.439996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.443109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:43.508596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27c473-f6aa-4bc8-95ca-ef9f257ad20c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.549237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.549957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.550247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.550527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.551374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=721f2eb2b5b94eefaedcc5c977f20aa8) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:43.551692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.553147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.562853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 42/92] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:43 2022] GET /identity/v3/role_assignments?user.id=721f2eb2b5b94eefaedcc5c977f20aa8&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.562853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.571380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bc03f-80eb-4aaa-8af4-4059dce62ea6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.615999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.616625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.616914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.617318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.618317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=fb50bdfd467346e58d39bc41efeb3f72) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:43.618642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.620134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.628261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 51/93] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:43 2022] GET /identity/v3/role_assignments?user.id=fb50bdfd467346e58d39bc41efeb3f72&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.629667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:43.693757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:43.741979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67148f53-844c-48f5-84b4-2d4dabb446ee None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.770077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:43.803066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.804127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.804810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.805321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.806434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] RBAC: Adding query filter params (role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=721f2eb2b5b94eefaedcc5c977f20aa8) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:43.806957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:43.808931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:43.816880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 43/94] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:43 2022] GET /identity/v3/role_assignments?user.id=721f2eb2b5b94eefaedcc5c977f20aa8&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=0778d0e990d0435eaff002965dc033ca => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:43.870772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc747f-5ba0-4cb0-b583-e991051910c5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:43.915105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:43.916175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:43.916665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:43.917214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:43.999533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:44.001660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:44.029236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:44.118199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 52/95] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:44.124449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:44.258200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba16c2-4422-473f-8460-766192e67c64 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:44.307910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c742-3f50-46ae-a6ba-9fbe10ef82fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:44.309425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c742-3f50-46ae-a6ba-9fbe10ef82fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:44.309899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c742-3f50-46ae-a6ba-9fbe10ef82fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:44.310189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c742-3f50-46ae-a6ba-9fbe10ef82fd None admin] PATH_INFO: `/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:44.311406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c742-3f50-46ae-a6ba-9fbe10ef82fd None admin] RBAC: Authorizing `identity:get_project(project_id=e1bdd3fbc064463a82dd8260dbf115fc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:44.312867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c742-3f50-46ae-a6ba-9fbe10ef82fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:44.314791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 44/96] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:44 2022] GET /identity/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:44.321522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:44.432839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e0764-fd12-47f6-aaea-900b0b3591d2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:44.458426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:44.476529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74318d5-0f8b-4a6f-b03f-e559a795013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:44.477206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74318d5-0f8b-4a6f-b03f-e559a795013d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:44.477524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74318d5-0f8b-4a6f-b03f-e559a795013d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:44.477811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74318d5-0f8b-4a6f-b03f-e559a795013d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:44.478662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74318d5-0f8b-4a6f-b03f-e559a795013d None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=e1bdd3fbc064463a82dd8260dbf115fc, user.id=721f2eb2b5b94eefaedcc5c977f20aa8) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:44.478982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74318d5-0f8b-4a6f-b03f-e559a795013d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:44.480483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74318d5-0f8b-4a6f-b03f-e559a795013d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:44.487062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 53/97] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:44 2022] GET /identity/v3/role_assignments?user.id=721f2eb2b5b94eefaedcc5c977f20aa8&scope.project.id=e1bdd3fbc064463a82dd8260dbf115fc&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:46.295056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644c83-3f02-4613-8af8-7e6c5d00ec3d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.295608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644c83-3f02-4613-8af8-7e6c5d00ec3d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.295608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53644c83-3f02-4613-8af8-7e6c5d00ec3d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.297012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 45/98] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:46.302341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462769-08ad-4941-8a60-cb70f84db6a4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.302751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462769-08ad-4941-8a60-cb70f84db6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.302920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c462769-08ad-4941-8a60-cb70f84db6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.326482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4c462769-08ad-4941-8a60-cb70f84db6a4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:46.327703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4c462769-08ad-4941-8a60-cb70f84db6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:46.423574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 54/99] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:46.467773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53644c83-3f02-4613-8af8-7e6c5d00ec3d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:46.534515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:46.619658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334b8e-2163-4917-9c92-aa18bdea333e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.619984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334b8e-2163-4917-9c92-aa18bdea333e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.620227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334b8e-2163-4917-9c92-aa18bdea333e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.622770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 55/100] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:46.623936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53644c83-3f02-4613-8af8-7e6c5d00ec3d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:46.626832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68cbb-0064-49fb-b47d-30c99ea69e7e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.627127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68cbb-0064-49fb-b47d-30c99ea69e7e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.627410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68cbb-0064-49fb-b47d-30c99ea69e7e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.629152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 56/101] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:46.630199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb6ad-64ad-4f7f-82c1-e74856616491 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.630613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb6ad-64ad-4f7f-82c1-e74856616491 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.630788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cb6ad-64ad-4f7f-82c1-e74856616491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.666487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e96cb6ad-64ad-4f7f-82c1-e74856616491 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:46.673379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e96cb6ad-64ad-4f7f-82c1-e74856616491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:46.679723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5b3de-1d88-4179-acee-8ceeb73d33c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:46.680777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b3de-1d88-4179-acee-8ceeb73d33c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.681289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b3de-1d88-4179-acee-8ceeb73d33c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.681795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5b3de-1d88-4179-acee-8ceeb73d33c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.701731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5b3de-1d88-4179-acee-8ceeb73d33c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-dab5b3de-1d88-4179-acee-8ceeb73d33c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:46.709993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:46.710868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:53:46.711621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:46.713985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 46/102] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:46.716203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e70b8-73b4-4c29-b348-2c6fcc71dea1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.716713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e70b8-73b4-4c29-b348-2c6fcc71dea1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.717181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e70b8-73b4-4c29-b348-2c6fcc71dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.734948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-561e70b8-73b4-4c29-b348-2c6fcc71dea1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:46.736461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-561e70b8-73b4-4c29-b348-2c6fcc71dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:46.805067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 57/103] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:46.805804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb6ad-64ad-4f7f-82c1-e74856616491 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:46.813457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 47/104] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:46.815077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6064-3b84-4dce-b3c4-db3614834c18 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.815659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6064-3b84-4dce-b3c4-db3614834c18 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.816142 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb6064-3b84-4dce-b3c4-db3614834c18 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.817704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 48/105] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:46.822805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970316-c04e-4fa6-b1e5-cac62daa6c68 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.823296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970316-c04e-4fa6-b1e5-cac62daa6c68 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.823781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29970316-c04e-4fa6-b1e5-cac62daa6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.853438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-29970316-c04e-4fa6-b1e5-cac62daa6c68 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:46.854652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29970316-c04e-4fa6-b1e5-cac62daa6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:46.867285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:46.882574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:46.926189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 49/106] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:46.926851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29970316-c04e-4fa6-b1e5-cac62daa6c68 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:46.943797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cb6ad-64ad-4f7f-82c1-e74856616491 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:46.983706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:46.984858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:46.985166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:46.985754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:46.986517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:46.986997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:46.989030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:47.000674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 58/107] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:47.001386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.039667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29970316-c04e-4fa6-b1e5-cac62daa6c68 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.075826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8362b-1884-44a6-adb7-e562936c9bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.076928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8362b-1884-44a6-adb7-e562936c9bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.077493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8362b-1884-44a6-adb7-e562936c9bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.077948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8362b-1884-44a6-adb7-e562936c9bf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.094892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8362b-1884-44a6-adb7-e562936c9bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-52d8362b-1884-44a6-adb7-e562936c9bf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:47.102729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:47.103794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:47.104736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 50/108] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:47.106942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857631-749b-4710-90f8-362216b6977f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.106942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857631-749b-4710-90f8-362216b6977f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.106942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14857631-749b-4710-90f8-362216b6977f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.112537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 51/109] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:47.112537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857631-749b-4710-90f8-362216b6977f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.124506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db26319-d4e6-472c-8e33-ea0a40fd5791 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.134151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.140343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.164460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.165293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.165579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.165891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.167100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:47.168811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:47.170445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 59/110] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:47.171052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.231284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14857631-749b-4710-90f8-362216b6977f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.270925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.271714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.272001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.272784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.285277 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b17ae2-cce7-4608-b9d7-861f79fb20d6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.285700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:47.293647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:47.294483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:47.296493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 52/111] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:47.300353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.323664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2732-a641-4b97-ae8e-dd749c416677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.325318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2732-a641-4b97-ae8e-dd749c416677 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.325834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2732-a641-4b97-ae8e-dd749c416677 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.326183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2732-a641-4b97-ae8e-dd749c416677 None admin] PATH_INFO: `/v3/users/8fe1b88247304912a89c2115bd2c7535` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.341588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2732-a641-4b97-ae8e-dd749c416677 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe1b88247304912a89c2115bd2c7535)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:47.343051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2732-a641-4b97-ae8e-dd749c416677 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:47.349158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 60/112] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/users/8fe1b88247304912a89c2115bd2c7535 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:47.349158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5100a31-cc3c-4326-bbf9-c889dee5f829 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.349158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5100a31-cc3c-4326-bbf9-c889dee5f829 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.349158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5100a31-cc3c-4326-bbf9-c889dee5f829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.364648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b5100a31-cc3c-4326-bbf9-c889dee5f829 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:47.365861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b5100a31-cc3c-4326-bbf9-c889dee5f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:47.394074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.400834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.413506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df68ac-a5d1-4de2-aa57-f6d22eda15be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.449450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 61/113] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:47.450625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5100a31-cc3c-4326-bbf9-c889dee5f829 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.466408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.467436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.468103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.468473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.469585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:47.470005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:47.471730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:47.483062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 53/114] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:47.483696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.573426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5100a31-cc3c-4326-bbf9-c889dee5f829 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.592784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92298902-4063-4b0b-89f2-dd1c8baff6b6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.609293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.609978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.610258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.610531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.611231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:47.612679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:47.626767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.627525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.627861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.628198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.629060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:47.629458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:47.630996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:47.637480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 62/115] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:53:47 2022] POST /identity/v3/projects => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:47.640116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 54/116] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:47.640936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.646414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.655456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.669394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.766904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206d3d-b370-4662-9aad-728e948f26c7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.770919 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e716ae6-7afc-4416-934e-d5bf0538001f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.809645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.810583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cedd1-bbe0-4f42-9de4-117491fa4295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.811169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.811291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cedd1-bbe0-4f42-9de4-117491fa4295 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.811455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.811544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cedd1-bbe0-4f42-9de4-117491fa4295 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.811740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.811840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cedd1-bbe0-4f42-9de4-117491fa4295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.823424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:47.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:47.833675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:47.834414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 55/117] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:47.835016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:47.887378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cedd1-bbe0-4f42-9de4-117491fa4295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:47.889464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296cedd1-bbe0-4f42-9de4-117491fa4295 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:47.905157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.910107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:47.944810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c43511-27ef-4e09-bb4e-60dcf058b8f4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:47.992413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:47.993938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:47.994235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:47.994519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:47.996534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:47.998475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.004554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 63/118] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:48.004692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 56/119] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:47 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.004766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817212e0-5e25-4677-a670-855bb29c2bd3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.004847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.004921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817212e0-5e25-4677-a670-855bb29c2bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.004921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817212e0-5e25-4677-a670-855bb29c2bd3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.004921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 64/120] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:48.007304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817212e0-5e25-4677-a670-855bb29c2bd3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.123588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817212e0-5e25-4677-a670-855bb29c2bd3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.127760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e062c-df83-4b5e-987f-f2d4454aa4e4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.145497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:48.164256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.165504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.165792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.166076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] PATH_INFO: `/v3/users/fb50bdfd467346e58d39bc41efeb3f72` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.167272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] RBAC: Authorizing `identity:get_user(user_id=fb50bdfd467346e58d39bc41efeb3f72)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.167379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.168197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.168693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.169046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.169301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.169860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:48.170178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.171256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 57/121] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/users/fb50bdfd467346e58d39bc41efeb3f72 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.171851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.173990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.177855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:48.189393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 65/122] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.190628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.287850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa0006-aca8-4ace-8753-a9896a6eb2f9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.301874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f90d-5bbf-46cb-a716-b786d7115afd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.326829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33d779-f719-46f8-bfa2-64721ee92748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.327696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33d779-f719-46f8-bfa2-64721ee92748 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.327980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33d779-f719-46f8-bfa2-64721ee92748 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.328256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33d779-f719-46f8-bfa2-64721ee92748 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.329727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33d779-f719-46f8-bfa2-64721ee92748 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.331167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33d779-f719-46f8-bfa2-64721ee92748 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.332867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 58/123] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.334018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8095e-d7d1-41d1-b050-ba43a1a66f0b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.334301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8095e-d7d1-41d1-b050-ba43a1a66f0b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.334576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8095e-d7d1-41d1-b050-ba43a1a66f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.344694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.346179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.346464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.346742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.347963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.349452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.351229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 66/124] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.352022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.357185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-56d8095e-d7d1-41d1-b050-ba43a1a66f0b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:48.358440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-56d8095e-d7d1-41d1-b050-ba43a1a66f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:48.408008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:48.430498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 59/125] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:48.433665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8095e-d7d1-41d1-b050-ba43a1a66f0b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.433883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:48.480406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583a31d-fe5f-4f15-a67b-545de71e9aa4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.518023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.518888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.519185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.519467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.520651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.522141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.523844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 67/126] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.526538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.548298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8095e-d7d1-41d1-b050-ba43a1a66f0b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.585754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.586625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.586902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.587175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.588356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.590388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.592183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 60/127] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.592751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.648069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114a77f-3cd0-4c08-ae76-609fd03d88e7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.662809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:48.663132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:48.686377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.687032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.687316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.687594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.688425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] RBAC: Adding query filter params (role.id=8054996023414698bb5845c03d2c1751, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=8fe1b88247304912a89c2115bd2c7535) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:48.688736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.690218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.696242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 68/128] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/role_assignments?user.id=8fe1b88247304912a89c2115bd2c7535&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=8054996023414698bb5845c03d2c1751 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:48.697820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e115c70-3107-49ec-81af-07dce3ee1f6b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.702472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.740500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.741474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.741776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.742042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/721f2eb2b5b94eefaedcc5c977f20aa8/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.745645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] RBAC: Authorizing `identity:create_grant(project_id=08803b5100bc4cd18199dfeeba2b7ab5, user_id=721f2eb2b5b94eefaedcc5c977f20aa8, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.747473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:48.764274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 61/129] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:53:48 2022] PUT /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/721f2eb2b5b94eefaedcc5c977f20aa8/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:53:48.765072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.877168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8979f71-4bc7-4a81-a35c-851d22a66921 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.929440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782a719-62cf-46c5-b071-96e62d89ce9d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:48.935340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.936492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.936987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.937514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.957753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:48.966746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:48.967656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:48.968399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:48.969282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:48.973332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 69/130] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:48.975023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:48.979865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:48.981539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:48.986727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:48.986727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/fb50bdfd467346e58d39bc41efeb3f72/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:48.998400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] RBAC: Authorizing `identity:create_grant(project_id=08803b5100bc4cd18199dfeeba2b7ab5, user_id=fb50bdfd467346e58d39bc41efeb3f72, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:48.999916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:49.024147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 62/131] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:53:48 2022] PUT /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/fb50bdfd467346e58d39bc41efeb3f72/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:53:49.035116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:49.084641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:49.180007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4448af0-05fb-45a8-9bbe-2fbfd23a00ef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:49.220241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:49.220241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:49.220241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:49.220241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:49.220668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:49.220818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:49.223548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:49.247058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 63/132] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:49.263298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:49.287360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306a4e6-2cab-41ae-893e-f1fe394e5cdf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:49.352398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:49.389761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:49.390660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:49.390958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:49.391680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:49.393314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:49.394835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:49.396753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 70/133] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:48 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:49.404339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:49.422877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4f284-9483-40a5-9478-2518e10c3ab4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:49.494522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:49.497162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:49.497480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:49.497757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:49.499959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:49.505913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:49.511239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 64/134] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:49 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:49.517838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:49.731365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e812879-bb80-4daa-b624-f244302d1796 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:49.755638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356f5b5-0bc1-4765-9b50-22b363bc5fd7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:49.757773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:49.767464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:49.768337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:49.768647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:49.769037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] PATH_INFO: `/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:49.770941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] RBAC: Authorizing `identity:get_project(project_id=e1bdd3fbc064463a82dd8260dbf115fc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:49.772591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:49.774740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 65/135] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:49 2022] GET /identity/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:49.774853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:49.780139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:49.833486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ace647-80c7-4c4f-a6cc-88d41c1d1c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:49.834388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace647-80c7-4c4f-a6cc-88d41c1d1c71 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:49.834672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace647-80c7-4c4f-a6cc-88d41c1d1c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:49.834949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ace647-80c7-4c4f-a6cc-88d41c1d1c71 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/721f2eb2b5b94eefaedcc5c977f20aa8/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:49.838841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ace647-80c7-4c4f-a6cc-88d41c1d1c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=08803b5100bc4cd18199dfeeba2b7ab5, user_id=721f2eb2b5b94eefaedcc5c977f20aa8, role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:49.842754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ace647-80c7-4c4f-a6cc-88d41c1d1c71 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:49.874150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 71/136] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:53:49 2022] PUT /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/721f2eb2b5b94eefaedcc5c977f20aa8/roles/0778d0e990d0435eaff002965dc033ca => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:53:49.931070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcd4b3-a953-48a5-aab8-c1dddd163037 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:49.968954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a58588-9abc-4939-8ff2-07c3c31945de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:49.969887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58588-9abc-4939-8ff2-07c3c31945de None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:49.970169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58588-9abc-4939-8ff2-07c3c31945de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:49.970444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a58588-9abc-4939-8ff2-07c3c31945de None admin] PATH_INFO: `/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc/users/721f2eb2b5b94eefaedcc5c977f20aa8/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:49.972435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58588-9abc-4939-8ff2-07c3c31945de None admin] RBAC: Authorizing `identity:create_grant(project_id=e1bdd3fbc064463a82dd8260dbf115fc, user_id=721f2eb2b5b94eefaedcc5c977f20aa8, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:49.973929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a58588-9abc-4939-8ff2-07c3c31945de None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:49.992782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 66/137] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:53:49 2022] PUT /identity/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc/users/721f2eb2b5b94eefaedcc5c977f20aa8/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:53:50.062629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba5f4-00e0-45de-8ca2-734f1f2d2251 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:50.062977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba5f4-00e0-45de-8ca2-734f1f2d2251 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:50.063202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba5f4-00e0-45de-8ca2-734f1f2d2251 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:50.064744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 72/138] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:50.071099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5e98-95fe-4b6a-967a-a69c8f83178f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:50.071403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5e98-95fe-4b6a-967a-a69c8f83178f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:50.071874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a5e98-95fe-4b6a-967a-a69c8f83178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:50.100817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-506a5e98-95fe-4b6a-967a-a69c8f83178f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:50.102152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-506a5e98-95fe-4b6a-967a-a69c8f83178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:50.155624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:50.183980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 67/139] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:50.217620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba5f4-00e0-45de-8ca2-734f1f2d2251 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:50.391938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba5f4-00e0-45de-8ca2-734f1f2d2251 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:50.456518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369a833-3f7b-4057-af3f-d25270618275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:50.457862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369a833-3f7b-4057-af3f-d25270618275 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:50.458347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369a833-3f7b-4057-af3f-d25270618275 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:50.458806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369a833-3f7b-4057-af3f-d25270618275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:50.460862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369a833-3f7b-4057-af3f-d25270618275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:50.463549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369a833-3f7b-4057-af3f-d25270618275 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:50.467289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 73/140] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:50.476155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a5e98-95fe-4b6a-967a-a69c8f83178f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:50.647491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a5e98-95fe-4b6a-967a-a69c8f83178f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:50.692823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484539a6-8727-4d49-a330-5b83a84c06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:50.693541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484539a6-8727-4d49-a330-5b83a84c06cb None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:50.693834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484539a6-8727-4d49-a330-5b83a84c06cb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:50.694118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484539a6-8727-4d49-a330-5b83a84c06cb None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:50.694839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484539a6-8727-4d49-a330-5b83a84c06cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:50.696440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484539a6-8727-4d49-a330-5b83a84c06cb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:50.725807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 68/141] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:53:50 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:53:52.078853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269f87-d23c-47f0-a9a2-f237baa780ec None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.079646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269f87-d23c-47f0-a9a2-f237baa780ec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.079722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269f87-d23c-47f0-a9a2-f237baa780ec None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.081065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 74/142] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:52.086693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070f35-7a11-40de-9189-49d3b4112998 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.087115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070f35-7a11-40de-9189-49d3b4112998 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.087315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070f35-7a11-40de-9189-49d3b4112998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.111005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-36070f35-7a11-40de-9189-49d3b4112998 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:52.112931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36070f35-7a11-40de-9189-49d3b4112998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:52.152449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:52.203544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 69/143] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:52.228608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269f87-d23c-47f0-a9a2-f237baa780ec None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:52.273762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:52.322614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb912-754c-4c36-bb23-f846e62b97ff None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.322935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb912-754c-4c36-bb23-f846e62b97ff None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.323178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdb912-754c-4c36-bb23-f846e62b97ff None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.324704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 70/144] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:52.331458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828457-7632-4203-a4b0-c7413a65f5ab None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.331852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828457-7632-4203-a4b0-c7413a65f5ab None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.332140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828457-7632-4203-a4b0-c7413a65f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.363476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c9828457-7632-4203-a4b0-c7413a65f5ab None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:52.364687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9828457-7632-4203-a4b0-c7413a65f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:52.404361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269f87-d23c-47f0-a9a2-f237baa780ec None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:52.475763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:52.476668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.476955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.477233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.490544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 71/145] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:52.492099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93388266-dbf3-4872-84d9-6344c5f94acb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.492394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93388266-dbf3-4872-84d9-6344c5f94acb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.492725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93388266-dbf3-4872-84d9-6344c5f94acb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.494276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 72/146] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:52.500700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b606-85dd-42bf-88b7-68d10804d56c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.500996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b606-85dd-42bf-88b7-68d10804d56c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.501281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4b606-85dd-42bf-88b7-68d10804d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.506254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:52.514732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:52.515615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:53:52.516363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:52.519025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-48a4b606-85dd-42bf-88b7-68d10804d56c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:52.520206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-48a4b606-85dd-42bf-88b7-68d10804d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:52.520844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 75/147] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:52.521741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:52.602695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 73/148] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:53:52.603462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4b606-85dd-42bf-88b7-68d10804d56c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:52.632147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:52.706458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:52.718001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b69ee-b9c8-4070-8691-eda651edfea3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:52.722072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4b606-85dd-42bf-88b7-68d10804d56c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:52.764223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:52.765036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.765316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.765616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.778584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:52.779438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.779717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.780214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.781362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:52.781607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:52.783273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:52.784692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:52.790055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:52.792086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 74/149] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:52.794990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:52.801390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 76/150] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:52.801390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:52.897925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:52.920272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8b549-37f1-4dea-b04e-d71683e67c3f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:52.963367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:52.965809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:52.967412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:52.967703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:52.995903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:53.003627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:53.005468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:53.007137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 75/151] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:53:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:53.013438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49ef7d-f6dc-4f69-80f3-9b1b7c8eb93f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:53.018033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:53.098031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:53.098735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:53.099021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:53.099301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:53.100070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:53.100379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:53.101879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:53.118685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 77/152] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:53.120626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:53.172730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.239888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86dfaf-52dd-48eb-a7ed-10cf2204fb75 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:53.282178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6c18-5b4d-41e8-b76c-88036daa19fe None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:53.307339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:53.308401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:53.308680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:53.309058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] PATH_INFO: `/v3/users/8fe1b88247304912a89c2115bd2c7535` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:53.311965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe1b88247304912a89c2115bd2c7535)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:53.313670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:53.315796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 76/153] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:53 2022] GET /identity/v3/users/8fe1b88247304912a89c2115bd2c7535 => generated 289 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:53.316402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:53.320123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:53.320795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:53.321077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:53.321371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:53.322515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:53.322819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:53.324458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:53.335301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 78/154] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:53.336388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:53.347216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.430542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.451389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cda8c-9a8c-4f10-9bbd-0219722ed190 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:53.502092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:53.502978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:53.503258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:53.503534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:53.504808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:53.506288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:53.508327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 79/155] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:53 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:53.509188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:53.528618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcd87a-695b-410d-95a2-ed5091b07d43 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:53.590712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:53.591594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:53.591974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:53.592251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:53.595480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:53.597035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:53.598709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 77/156] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:53 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:53.599440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:53.662429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e857a15-d637-493c-87bf-110094f1d89d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:53.722257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:53.723079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:53.723364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:53.723642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] PATH_INFO: `/v3/users/fb50bdfd467346e58d39bc41efeb3f72` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:53.725077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=fb50bdfd467346e58d39bc41efeb3f72)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:53.726612 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:53.728632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 80/157] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:53 2022] GET /identity/v3/users/fb50bdfd467346e58d39bc41efeb3f72 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:53.729504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:53.769151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.771368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:53.790594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814897c1-c9e8-4485-b1f1-88275125ec0f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:53.834334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:53.835251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:53.835550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:53.836758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/8fe1b88247304912a89c2115bd2c7535/roles/8054996023414698bb5845c03d2c1751` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:53.845373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] RBAC: Authorizing `identity:create_grant(project_id=08803b5100bc4cd18199dfeeba2b7ab5, user_id=8fe1b88247304912a89c2115bd2c7535, role_id=8054996023414698bb5845c03d2c1751)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:53.845373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:53.878687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 78/158] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:53:53 2022] PUT /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/users/8fe1b88247304912a89c2115bd2c7535/roles/8054996023414698bb5845c03d2c1751 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:53:53.879752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:54.001102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12cd95-39be-4539-87db-8be4430a2fb7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:54.092280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243a5f-71cc-4295-a0ba-592b722ea94a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:54.107136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d21e52-efe4-46c8-9269-b3a2cb3a2129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:54.108409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d21e52-efe4-46c8-9269-b3a2cb3a2129 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.108855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d21e52-efe4-46c8-9269-b3a2cb3a2129 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.109281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d21e52-efe4-46c8-9269-b3a2cb3a2129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.139706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049fcdf-b59d-4b10-80be-b25be2dec525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:54.140735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049fcdf-b59d-4b10-80be-b25be2dec525 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.141216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049fcdf-b59d-4b10-80be-b25be2dec525 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.141726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049fcdf-b59d-4b10-80be-b25be2dec525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.165856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:54.285921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049fcdf-b59d-4b10-80be-b25be2dec525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:54.288012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049fcdf-b59d-4b10-80be-b25be2dec525 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:54.294531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d21e52-efe4-46c8-9269-b3a2cb3a2129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:54.296217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d21e52-efe4-46c8-9269-b3a2cb3a2129 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:54.314246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:54.403580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 81/159] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:54.405140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085381-48ab-4081-ae0a-617804911911 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.405606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085381-48ab-4081-ae0a-617804911911 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.406028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83085381-48ab-4081-ae0a-617804911911 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.407757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 82/160] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:54.409119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad231a-bcd4-4cca-9efa-9d479050981b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.409593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad231a-bcd4-4cca-9efa-9d479050981b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.410033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad231a-bcd4-4cca-9efa-9d479050981b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.411432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 83/161] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:54.413842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad231a-bcd4-4cca-9efa-9d479050981b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:54.507292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 79/162] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:54.508948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60599195-a01f-49b4-918b-e6c6b5b5aafe None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.515512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60599195-a01f-49b4-918b-e6c6b5b5aafe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.516046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60599195-a01f-49b4-918b-e6c6b5b5aafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.549984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-60599195-a01f-49b4-918b-e6c6b5b5aafe None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:54.551561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-60599195-a01f-49b4-918b-e6c6b5b5aafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:54.612086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:54.635242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad231a-bcd4-4cca-9efa-9d479050981b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:54.679257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:54.689949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 80/163] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:54.692193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78926745-12dc-47de-93fd-741ca611bf6a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.692689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78926745-12dc-47de-93fd-741ca611bf6a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.693165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78926745-12dc-47de-93fd-741ca611bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.721459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:54.722577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.723022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.723448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.724877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:54.726279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-78926745-12dc-47de-93fd-741ca611bf6a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:54.726668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:54.727745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-78926745-12dc-47de-93fd-741ca611bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:54.728735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 84/164] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:54 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:54.729696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:54.852753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 81/165] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:54.853572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78926745-12dc-47de-93fd-741ca611bf6a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:54.859155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403553-36a1-4a8c-a1b6-54b5b1bdfc98 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:54.898673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:54.899804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:54.900232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:54.900654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:54.902726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:54.904504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:54.906415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 85/166] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:54 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:54.907370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:54.964100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:55.014635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac67b78-1cbd-4bd5-a0ee-3670f0633464 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:55.055482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78926745-12dc-47de-93fd-741ca611bf6a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:55.058750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:55.065394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.065394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.065394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.065662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:55.091052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:55.108523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:55.109807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:55.110841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:55.113284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 86/167] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:53:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:55.114339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:55.134522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:55.135251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.135531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.135862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.137432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=721f2eb2b5b94eefaedcc5c977f20aa8) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:55.137752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:55.139491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:55.159417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 82/168] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:54 2022] GET /identity/v3/role_assignments?user.id=721f2eb2b5b94eefaedcc5c977f20aa8&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:55.160607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:55.254502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36608f-e8fd-4033-a58f-40f284b256e9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:55.273711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:55.307589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:55.308716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.309168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.314649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.315958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=fb50bdfd467346e58d39bc41efeb3f72) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:55.317644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:55.319511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:55.337180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 87/169] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:55 2022] GET /identity/v3/role_assignments?user.id=fb50bdfd467346e58d39bc41efeb3f72&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:55.342153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:55.425713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896cf93-b1d8-458a-b7bc-f7cae5d340b7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:55.505126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf9189-8b4b-47b6-b86f-a5966cc63c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:55.506219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9189-8b4b-47b6-b86f-a5966cc63c44 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.506678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9189-8b4b-47b6-b86f-a5966cc63c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.507099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf9189-8b4b-47b6-b86f-a5966cc63c44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.539329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf9189-8b4b-47b6-b86f-a5966cc63c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6bdf9189-8b4b-47b6-b86f-a5966cc63c44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:55.555998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:55.557042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:53:55.557851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:55.565369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf760b-af0f-4615-ba04-865cafa97cbf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:55.565936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 83/170] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:55.567853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161bb9-e930-4ce4-a526-cd57b12eb86c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.568351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161bb9-e930-4ce4-a526-cd57b12eb86c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.568835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161bb9-e930-4ce4-a526-cd57b12eb86c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.570479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 84/171] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:55.571385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161bb9-e930-4ce4-a526-cd57b12eb86c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:55.619909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:55.626685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af6c09-584f-40d3-bdaa-c890c365c256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:55.627375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af6c09-584f-40d3-bdaa-c890c365c256 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.627662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af6c09-584f-40d3-bdaa-c890c365c256 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.627939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af6c09-584f-40d3-bdaa-c890c365c256 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.628703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af6c09-584f-40d3-bdaa-c890c365c256 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:55.629016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af6c09-584f-40d3-bdaa-c890c365c256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:55.630456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af6c09-584f-40d3-bdaa-c890c365c256 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:55.644150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 88/172] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:53:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:55.650578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9793-8ab3-482a-af73-7735e46768e8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.651040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9793-8ab3-482a-af73-7735e46768e8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.651464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e9793-8ab3-482a-af73-7735e46768e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.679124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-916e9793-8ab3-482a-af73-7735e46768e8 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:55.680539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-916e9793-8ab3-482a-af73-7735e46768e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:55.721783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:55.794098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161bb9-e930-4ce4-a526-cd57b12eb86c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:55.799665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 89/173] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:55.800620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e9793-8ab3-482a-af73-7735e46768e8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:55.834773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:55.835862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:55.836545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:55.836963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:55.837892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:55.838336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:55.840575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:55.852513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 85/174] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:55.854082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:55.965939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e9793-8ab3-482a-af73-7735e46768e8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:55.971311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:55.994764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a1704-d413-4ba5-97c6-b629379a2d30 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.010628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.011706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.012088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.012629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.014000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:56.015640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:56.018251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 90/175] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:55 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:56.021372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.063205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:56.065859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dd88a-e7f2-446a-87f7-957817bbaa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.068404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd88a-e7f2-446a-87f7-957817bbaa58 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.068404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd88a-e7f2-446a-87f7-957817bbaa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.068404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dd88a-e7f2-446a-87f7-957817bbaa58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.083138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dd88a-e7f2-446a-87f7-957817bbaa58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a17dd88a-e7f2-446a-87f7-957817bbaa58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:56.093159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:56.094043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:56.094805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 86/176] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:56.096004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa72a43-6e6c-4dd8-a563-4ed0ca2d2669 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.096206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa72a43-6e6c-4dd8-a563-4ed0ca2d2669 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.096490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa72a43-6e6c-4dd8-a563-4ed0ca2d2669 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.098035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 87/177] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:56.098754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa72a43-6e6c-4dd8-a563-4ed0ca2d2669 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.142516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f80cc3-fd48-4cba-86aa-a5e2305e5690 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.181114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417784e-723b-4668-a0f2-1c354b9824e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.182065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417784e-723b-4668-a0f2-1c354b9824e7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.182348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417784e-723b-4668-a0f2-1c354b9824e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.182624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417784e-723b-4668-a0f2-1c354b9824e7 None admin] PATH_INFO: `/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.184256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417784e-723b-4668-a0f2-1c354b9824e7 None admin] RBAC: Authorizing `identity:get_user(user_id=721f2eb2b5b94eefaedcc5c977f20aa8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:56.185841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417784e-723b-4668-a0f2-1c354b9824e7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:56.187593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 91/178] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/users/721f2eb2b5b94eefaedcc5c977f20aa8 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:56.188767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461549-6d45-4522-a611-1cece27bc60b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.189049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461549-6d45-4522-a611-1cece27bc60b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.189327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461549-6d45-4522-a611-1cece27bc60b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.193734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 92/179] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:56.194814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461549-6d45-4522-a611-1cece27bc60b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.216463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa72a43-6e6c-4dd8-a563-4ed0ca2d2669 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.255079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3dfce-911c-49f5-8613-a8aa5052834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.255764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3dfce-911c-49f5-8613-a8aa5052834b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.256051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3dfce-911c-49f5-8613-a8aa5052834b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.256331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3dfce-911c-49f5-8613-a8aa5052834b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.272749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:56.303553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461549-6d45-4522-a611-1cece27bc60b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.307047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:56.333364 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3dfce-911c-49f5-8613-a8aa5052834b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:56.335160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3dfce-911c-49f5-8613-a8aa5052834b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:56.345053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749639c-fa8a-4a46-884e-22727b6abc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.345755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749639c-fa8a-4a46-884e-22727b6abc37 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.346037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749639c-fa8a-4a46-884e-22727b6abc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.346311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749639c-fa8a-4a46-884e-22727b6abc37 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.347068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749639c-fa8a-4a46-884e-22727b6abc37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:56.347377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749639c-fa8a-4a46-884e-22727b6abc37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:56.348754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749639c-fa8a-4a46-884e-22727b6abc37 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:56.357907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 93/180] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:56.359306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1af8f-627a-4ebc-97e3-2436f347d304 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.359594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1af8f-627a-4ebc-97e3-2436f347d304 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.359872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1af8f-627a-4ebc-97e3-2436f347d304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.380035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-efd1af8f-627a-4ebc-97e3-2436f347d304 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:56.382082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-efd1af8f-627a-4ebc-97e3-2436f347d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:56.455927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 88/181] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:56.458309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 94/182] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:56.459161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1af8f-627a-4ebc-97e3-2436f347d304 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.461880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51f20-2386-4d9e-95ab-c60c79b94a75 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.462169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51f20-2386-4d9e-95ab-c60c79b94a75 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.462449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51f20-2386-4d9e-95ab-c60c79b94a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.479638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4ca51f20-2386-4d9e-95ab-c60c79b94a75 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:56.481156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4ca51f20-2386-4d9e-95ab-c60c79b94a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:56.524757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:56.552212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 89/183] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:56.559027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51f20-2386-4d9e-95ab-c60c79b94a75 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.570488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:56.577190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1af8f-627a-4ebc-97e3-2436f347d304 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.613553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.614198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.614481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.614750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.673008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51f20-2386-4d9e-95ab-c60c79b94a75 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.687461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:56.688930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:56.709949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.710825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.711103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.711374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] PATH_INFO: `/v3/users/9087ae08bf64499597888d5c5937ceb0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.725800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] RBAC: Authorizing `identity:get_user(user_id=9087ae08bf64499597888d5c5937ceb0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:56.727261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:56.729194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 90/184] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/users/9087ae08bf64499597888d5c5937ceb0 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:56.734387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.770354 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:56.804826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:56.812467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 95/185] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:56.812467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.847615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c82c-ef0a-4828-9c6d-eeef60007635 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.886681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.888059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.888335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.888607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.889890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:56.891489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:56.893854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 91/186] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:56.894087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:56.923103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba84083-2602-4a5a-8cf8-cce595005c4f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:56.960237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:56.961042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:56.961322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:56.961625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:56.971925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:56.980382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:56.981235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:53:56.982045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 96/187] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:56.982779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.008020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc93f2-92c5-4fa4-bf66-fab67bfda309 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.009499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.039935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.044450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.045262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.046018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.046301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.048743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.050231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.051865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 92/188] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:57.052636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.091484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff638f69-610f-420c-94b0-41afb187eeb6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.125435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72958c65-2b33-460a-b4ff-4d06e78d1031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.126079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958c65-2b33-460a-b4ff-4d06e78d1031 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.126384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958c65-2b33-460a-b4ff-4d06e78d1031 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.126719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958c65-2b33-460a-b4ff-4d06e78d1031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.155763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50ad0-74b9-41b4-a7b8-28e97101518b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.190472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.191333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.191615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.191889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] PATH_INFO: `/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.193091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] RBAC: Authorizing `identity:get_project(project_id=e1bdd3fbc064463a82dd8260dbf115fc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.194577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.195301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72958c65-2b33-460a-b4ff-4d06e78d1031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.196285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 93/189] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/projects/e1bdd3fbc064463a82dd8260dbf115fc => generated 312 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:57.196768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72958c65-2b33-460a-b4ff-4d06e78d1031 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.197050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.238571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.258914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.299918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe616c1e-ed65-4f6e-9d0d-cdbc01a29260 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.303634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 97/190] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:57.305027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057b9f-320b-46e1-a59b-309a541adb5f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.305316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057b9f-320b-46e1-a59b-309a541adb5f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.305618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057b9f-320b-46e1-a59b-309a541adb5f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.307215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 98/191] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:53:57.309104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac057b9f-320b-46e1-a59b-309a541adb5f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.338981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.340147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.340431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.340711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.341580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] RBAC: Adding query filter params (role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=721f2eb2b5b94eefaedcc5c977f20aa8) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:57.341896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.343333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.353672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 94/192] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/role_assignments?user.id=721f2eb2b5b94eefaedcc5c977f20aa8&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=0778d0e990d0435eaff002965dc033ca => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:57.353672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.426329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac057b9f-320b-46e1-a59b-309a541adb5f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.465690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.466473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.466762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.467033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.467805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:57.468388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.469582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.474882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189b8ee-0313-456c-905a-f084f4dc267f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.476744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.484618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 99/193] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:57.484618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.506909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.522086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.522780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.523470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.523751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.524479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.525982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.550841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 95/194] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:53:57 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:53:57.550841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.626780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b45a6-8444-48b7-8ef8-ed5393c2f42c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.666928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44644b-d110-412f-97c4-a758f05de131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.667735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44644b-d110-412f-97c4-a758f05de131 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.668011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44644b-d110-412f-97c4-a758f05de131 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.668636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44644b-d110-412f-97c4-a758f05de131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.669312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44644b-d110-412f-97c4-a758f05de131 None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=e1bdd3fbc064463a82dd8260dbf115fc, user.id=721f2eb2b5b94eefaedcc5c977f20aa8) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:57.669627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44644b-d110-412f-97c4-a758f05de131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.671057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44644b-d110-412f-97c4-a758f05de131 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.677699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316f45-43d7-4a1c-9aae-9b35883dff72 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.685638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 100/195] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/role_assignments?user.id=721f2eb2b5b94eefaedcc5c977f20aa8&scope.project.id=e1bdd3fbc064463a82dd8260dbf115fc&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:57.685638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4abd-6ad1-4961-ab2f-adfa6636986f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.685638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4abd-6ad1-4961-ab2f-adfa6636986f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.685638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b4abd-6ad1-4961-ab2f-adfa6636986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.704661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-826b4abd-6ad1-4961-ab2f-adfa6636986f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:53:57.706803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-826b4abd-6ad1-4961-ab2f-adfa6636986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:53:57.730628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.731516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.731802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.732089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.733962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.735469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.737268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 96/196] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:57.738164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.779269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.825390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 101/197] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:53:57.825390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4abd-6ad1-4961-ab2f-adfa6636986f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.848648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:57.885168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339c0a5-9e28-4a4f-8698-59ed8bdbb5f3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:57.937733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:57.938627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:57.938908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:57.939184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] PATH_INFO: `/v3/users/9087ae08bf64499597888d5c5937ceb0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:57.941456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] RBAC: Authorizing `identity:get_user(user_id=9087ae08bf64499597888d5c5937ceb0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:57.942933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:57.944837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 97/198] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/users/9087ae08bf64499597888d5c5937ceb0 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:57.945690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:57.968902 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b4abd-6ad1-4961-ab2f-adfa6636986f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:58.017907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:58.018679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:58.019027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:58.019375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:58.020300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=9087ae08bf64499597888d5c5937ceb0) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:58.020680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:58.022271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:58.029763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 102/199] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/role_assignments?user.id=9087ae08bf64499597888d5c5937ceb0&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:58.030462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:58.074680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:58.085465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fad47-4db5-4342-8248-99773c756377 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:58.119623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:58.125778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:58.126931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:58.127424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:58.127921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:58.140546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:53:58.147306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc5423-c62f-4a3e-bd70-0acbc07f4a59 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:53:58.149619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:53:58.150507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:53:58.151277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:53:58.154782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 98/200] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:53:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:53:58.160330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:58.222038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:58.225006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:58.227074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:58.227612 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:58.369001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542184-faba-41ce-9d3c-80e58f821b43 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:58.375398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:58.376897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:58.434016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:58.438225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:58.438518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:58.438800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:58.439581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:58.439892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:58.441329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:58.458627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 99/201] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:53:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:58.465862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:58.498944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:58.515274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:58.554605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 103/202] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:58.559555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:58.655200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e5060-bf25-4b53-9727-ccc38175554c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:58.719991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:58.720872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:58.721153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:58.721449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] PATH_INFO: `/v3/users/8fe1b88247304912a89c2115bd2c7535` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:58.722786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe1b88247304912a89c2115bd2c7535)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:58.724231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:58.725910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 100/203] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:53:58 2022] GET /identity/v3/users/8fe1b88247304912a89c2115bd2c7535 => generated 289 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:58.731509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:58.746165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217c4a8-3499-4de4-9792-4c9baf3c1c6b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:58.792740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:58.793967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:58.794698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:58.795175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:58.796610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:58.798293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:58.801219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 104/204] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:58 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:58.806469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:58.908188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:58.939355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:58.978260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5885c-a2ac-454f-897f-c4b7433a6bdd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:58.995890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907285e-5b31-4371-9a02-c10ec7c34736 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:59.019860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:59.020871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:59.021458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:59.022081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:59.023119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] RBAC: Adding query filter params (role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=9087ae08bf64499597888d5c5937ceb0) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:59.023629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:59.025479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:59.032073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 105/205] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:58 2022] GET /identity/v3/role_assignments?user.id=9087ae08bf64499597888d5c5937ceb0&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=0778d0e990d0435eaff002965dc033ca => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:53:59.043582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:59.044257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:59.044536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:59.044808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:59.121266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:59.122761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:59.236519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:59.259070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 101/206] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:53:59.264729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:59.377326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4f63d-4d6d-4abd-beb4-ae7776813503 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:59.387284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:53:59.415493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616bb14-466d-4ceb-8a61-f84ef8b148be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:59.416761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616bb14-466d-4ceb-8a61-f84ef8b148be None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:59.417374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616bb14-466d-4ceb-8a61-f84ef8b148be None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:59.418156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616bb14-466d-4ceb-8a61-f84ef8b148be None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:59.420153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616bb14-466d-4ceb-8a61-f84ef8b148be None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:59.422191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616bb14-466d-4ceb-8a61-f84ef8b148be None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:59.424599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 106/207] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:53:59 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:59.430175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:53:59.562137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9cd41-58b3-4913-b25b-f787f19723c4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:53:59.612398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81fa61-4f0e-42a9-904e-8c579746b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:53:59.613459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81fa61-4f0e-42a9-904e-8c579746b014 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:59.613943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81fa61-4f0e-42a9-904e-8c579746b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:59.614417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81fa61-4f0e-42a9-904e-8c579746b014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:59.615481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81fa61-4f0e-42a9-904e-8c579746b014 None admin] RBAC: Adding query filter params (role.id=8054996023414698bb5845c03d2c1751, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5, user.id=8fe1b88247304912a89c2115bd2c7535) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:53:59.615993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81fa61-4f0e-42a9-904e-8c579746b014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:53:59.617676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81fa61-4f0e-42a9-904e-8c579746b014 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:53:59.629966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 102/208] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:53:59 2022] GET /identity/v3/role_assignments?user.id=8fe1b88247304912a89c2115bd2c7535&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=8054996023414698bb5845c03d2c1751 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:53:59.991393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c94f-8d38-4876-9841-c18ae1c65841 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:53:59.992058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c94f-8d38-4876-9841-c18ae1c65841 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:53:59.992567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c94f-8d38-4876-9841-c18ae1c65841 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:53:59.994488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 107/209] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:00.000835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f946-02a2-4cd8-ba1a-8443cb550f51 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.001428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f946-02a2-4cd8-ba1a-8443cb550f51 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.001933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2f946-02a2-4cd8-ba1a-8443cb550f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.020665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-89f2f946-02a2-4cd8-ba1a-8443cb550f51 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:00.022203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89f2f946-02a2-4cd8-ba1a-8443cb550f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:00.080924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:00.107525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 103/210] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:00.131485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c94f-8d38-4876-9841-c18ae1c65841 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:00.159545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afe82f-9f20-40f6-b141-13ccae9ca8a1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.159847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afe82f-9f20-40f6-b141-13ccae9ca8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.160111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afe82f-9f20-40f6-b141-13ccae9ca8a1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.161688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 104/211] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:00.167730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694d03e-6913-4319-a9a2-a7e6c1159432 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.168030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694d03e-6913-4319-a9a2-a7e6c1159432 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.168316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694d03e-6913-4319-a9a2-a7e6c1159432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.189652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0694d03e-6913-4319-a9a2-a7e6c1159432 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:00.191360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0694d03e-6913-4319-a9a2-a7e6c1159432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:00.269680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c94f-8d38-4876-9841-c18ae1c65841 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:00.289467 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 105/212] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:00.308446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:00.309661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.310178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.310308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694d03e-6913-4319-a9a2-a7e6c1159432 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:00.310773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.322309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:00.331656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:00.332525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:00.333284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:00.336278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 108/213] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:00.342825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:00.387917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:00.436963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694d03e-6913-4319-a9a2-a7e6c1159432 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:00.447031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:00.475430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:00.476225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.476507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.476840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.477964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:00.479497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:00.481387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 106/214] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:00.487106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add16fe8-14be-4762-b507-faf921e6b9a8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:00.488270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:00.531256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e0771-fad4-46b8-919c-1c11efb8156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:00.531806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e0771-fad4-46b8-919c-1c11efb8156a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.532092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e0771-fad4-46b8-919c-1c11efb8156a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.532371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e0771-fad4-46b8-919c-1c11efb8156a None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.533150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e0771-fad4-46b8-919c-1c11efb8156a None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:00.533580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e0771-fad4-46b8-919c-1c11efb8156a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:00.535002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e0771-fad4-46b8-919c-1c11efb8156a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:00.546126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 109/215] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:00.551055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddcc81-5eec-4644-acd3-986b8a43717f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.551351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddcc81-5eec-4644-acd3-986b8a43717f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.551628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddcc81-5eec-4644-acd3-986b8a43717f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.553058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 110/216] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:00.558345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddcc81-5eec-4644-acd3-986b8a43717f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:00.613877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538e86-ca9b-4bba-a92e-6ee250c73af8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:00.651368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c997-4ab5-49f1-aade-89f0b5c8158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:00.652739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c997-4ab5-49f1-aade-89f0b5c8158a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.653028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c997-4ab5-49f1-aade-89f0b5c8158a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.653303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c997-4ab5-49f1-aade-89f0b5c8158a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.654421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c997-4ab5-49f1-aade-89f0b5c8158a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:00.655869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c997-4ab5-49f1-aade-89f0b5c8158a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:00.669974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:00.676350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddcc81-5eec-4644-acd3-986b8a43717f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:00.689378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 107/217] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:00 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:00.689378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5091ce-d958-478f-9cc5-5507de2c184f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.689378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5091ce-d958-478f-9cc5-5507de2c184f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.689378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5091ce-d958-478f-9cc5-5507de2c184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.711051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-de5091ce-d958-478f-9cc5-5507de2c184f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:00.713175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de5091ce-d958-478f-9cc5-5507de2c184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:00.719214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:00.720151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.720440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.720722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] PATH_INFO: `/v3/users/38bfb83a81934c0ea530c7f84add42a0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.737270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] RBAC: Authorizing `identity:get_user(user_id=38bfb83a81934c0ea530c7f84add42a0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:00.738938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:00.740867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 111/218] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:00 2022] GET /identity/v3/users/38bfb83a81934c0ea530c7f84add42a0 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:00.746689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:00.752250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:00.804110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 108/219] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:00.828257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5091ce-d958-478f-9cc5-5507de2c184f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:00.881398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7ae6f-3fd1-4a7d-a8fb-7532648cf007 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:00.924962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:00.925810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:00.926634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:00.926917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:00.958863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5091ce-d958-478f-9cc5-5507de2c184f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:00.962493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:01.000829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:01.001680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.001962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.002326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.021160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:01.023839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:01.025312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:01.030218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:01.031396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:01.032490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 109/220] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:01.037633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:01.068452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:01.155603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 112/221] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 13:54:01.161360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:01.167390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aa806-9d87-47f8-b28d-a9767531da7c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:01.208498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:01.209860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.210307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.210690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.212127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:01.212682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:01.215038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:01.226759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 110/222] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:01.231129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:01.232982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:01.301284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ee01-2a8a-410f-8200-b1e646e24b3f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:01.328511 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:01.346813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9fd4-c225-4cbb-9897-24ad7576078c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:01.352857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:01.357456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.358044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.358535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.360621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:01.362825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:01.366021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 113/223] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:01 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:01.372805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:01.407051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:01.408252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.408539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.408819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] PATH_INFO: `/v3/users/9087ae08bf64499597888d5c5937ceb0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.411283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] RBAC: Authorizing `identity:get_user(user_id=9087ae08bf64499597888d5c5937ceb0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:01.415103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:01.419347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 111/224] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:01 2022] GET /identity/v3/users/9087ae08bf64499597888d5c5937ceb0 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:01.427875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:01.557224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4efda-97ad-440b-b2e3-ef12b0d1aa97 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:01.594278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:01.595075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.595363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.595644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.596833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:01.598327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:01.600267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 112/225] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:01 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:01.605709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:01.633733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:01.679272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef884f-eeef-40f4-9396-35ec55b93a12 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:01.712785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:01.725791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefd3be-304d-465a-bfad-2e9f6d2f7b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:01.726545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd3be-304d-465a-bfad-2e9f6d2f7b63 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.726896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd3be-304d-465a-bfad-2e9f6d2f7b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.727236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd3be-304d-465a-bfad-2e9f6d2f7b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.728163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefd3be-304d-465a-bfad-2e9f6d2f7b63 None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=38bfb83a81934c0ea530c7f84add42a0) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:01.728543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefd3be-304d-465a-bfad-2e9f6d2f7b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:01.730423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefd3be-304d-465a-bfad-2e9f6d2f7b63 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:01.734070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312278-591b-455c-8bf4-5cac3339feb6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:01.736780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 114/226] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:01 2022] GET /identity/v3/role_assignments?user.id=38bfb83a81934c0ea530c7f84add42a0&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 259 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:01.738744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdbb0-4b53-4da5-9612-537904eb200a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.739303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdbb0-4b53-4da5-9612-537904eb200a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.739846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdbb0-4b53-4da5-9612-537904eb200a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.746229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 115/227] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:01.749601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496ea4-54b9-408d-a0d3-5d046159b035 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.749977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496ea4-54b9-408d-a0d3-5d046159b035 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.750331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496ea4-54b9-408d-a0d3-5d046159b035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.783589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ac496ea4-54b9-408d-a0d3-5d046159b035 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:01.784845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ac496ea4-54b9-408d-a0d3-5d046159b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:01.841989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:01.842957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:01.843247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:01.843522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/9087ae08bf64499597888d5c5937ceb0/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:01.848942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9850d74b2443dda42cfa15e364b370, user_id=9087ae08bf64499597888d5c5937ceb0, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:01.850418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:01.872872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 116/228] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:01.874921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 113/229] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:01 2022] PUT /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/9087ae08bf64499597888d5c5937ceb0/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:54:01.899067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac496ea4-54b9-408d-a0d3-5d046159b035 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:02.068089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac496ea4-54b9-408d-a0d3-5d046159b035 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:02.093746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:02.115209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:02.115958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:02.116236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:02.116512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:02.127914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:02.136840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:02.137752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:02.138957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 117/230] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:02.144303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:02.287731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:02.316198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec9868-39c7-46d4-8f25-a844c2b0ba87 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:02.368045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:02.368664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:02.368951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:02.369233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:02.370578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:02.370912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:02.372335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:02.385831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 114/231] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:02.395258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:02.607464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f754-298f-41fe-aa54-a9c5d4a7219a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:02.665082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:02.666534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:02.667530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:02.667967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] PATH_INFO: `/v3/users/9087ae08bf64499597888d5c5937ceb0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:02.670018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] RBAC: Authorizing `identity:get_user(user_id=9087ae08bf64499597888d5c5937ceb0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:02.672839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:02.676163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 118/232] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:02 2022] GET /identity/v3/users/9087ae08bf64499597888d5c5937ceb0 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:02.686441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:02.841369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2a8e9-3068-4e64-965e-6324ef20edf8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:02.880826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a34d7-5858-4eb3-ad57-a0d499436e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:02.881724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a34d7-5858-4eb3-ad57-a0d499436e65 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:02.882011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a34d7-5858-4eb3-ad57-a0d499436e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:02.882289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a34d7-5858-4eb3-ad57-a0d499436e65 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:02.886604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a34d7-5858-4eb3-ad57-a0d499436e65 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:02.888189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a34d7-5858-4eb3-ad57-a0d499436e65 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:02.889960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 115/233] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:02 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:02.899167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:03.022739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:03.116339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6d052-1d4b-4021-bf45-06f3c6c776f1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:03.165185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af056949-0aab-4f54-9cf9-bb439366786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:03.166109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056949-0aab-4f54-9cf9-bb439366786e None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:03.166391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056949-0aab-4f54-9cf9-bb439366786e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:03.166672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056949-0aab-4f54-9cf9-bb439366786e None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/9087ae08bf64499597888d5c5937ceb0/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:03.169023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af056949-0aab-4f54-9cf9-bb439366786e None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9850d74b2443dda42cfa15e364b370, user_id=9087ae08bf64499597888d5c5937ceb0, role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:03.170507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af056949-0aab-4f54-9cf9-bb439366786e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:03.204254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 119/234] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:02 2022] PUT /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/9087ae08bf64499597888d5c5937ceb0/roles/0778d0e990d0435eaff002965dc033ca => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:03.633893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc38a8-79a4-4927-928d-0db512f32d38 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:03.634390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc38a8-79a4-4927-928d-0db512f32d38 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:03.634831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc38a8-79a4-4927-928d-0db512f32d38 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:03.637733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 116/235] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:03.642761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9885fa-7e54-454f-b755-6162f3f41d69 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:03.643219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9885fa-7e54-454f-b755-6162f3f41d69 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:03.643315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9885fa-7e54-454f-b755-6162f3f41d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:03.666321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fe9885fa-7e54-454f-b755-6162f3f41d69 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:03.668212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fe9885fa-7e54-454f-b755-6162f3f41d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:03.755853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 120/236] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:03.786756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc38a8-79a4-4927-928d-0db512f32d38 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:03.810349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:03.931018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc38a8-79a4-4927-928d-0db512f32d38 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:03.969068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889296d0-d2d2-4764-b1ac-481388964dc2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:03.969408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889296d0-d2d2-4764-b1ac-481388964dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:03.969797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889296d0-d2d2-4764-b1ac-481388964dc2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:03.971339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 121/237] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:03.980713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46c16-a8c3-461d-b633-293c10db2aef None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:03.980863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:03.981091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46c16-a8c3-461d-b633-293c10db2aef None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:03.981269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46c16-a8c3-461d-b633-293c10db2aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:03.981551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:03.981829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:03.982100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.008482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:04.016614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a3f46c16-a8c3-461d-b633-293c10db2aef None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:04.017852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a3f46c16-a8c3-461d-b633-293c10db2aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:04.020960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:04.021841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:04.022645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:04.030096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 117/238] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:04.031018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:04.075761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:04.162926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 122/239] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:04.183265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:04.187485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46c16-a8c3-461d-b633-293c10db2aef None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:04.241382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f94ef-ee6d-4723-a2c3-ff2f53444d25 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:04.274153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:04.274829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.275113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.275389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.276155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:04.277113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:04.278942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:04.299060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 118/240] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:04.310374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:04.371134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46c16-a8c3-461d-b633-293c10db2aef None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:04.440057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:04.440771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.441052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.441325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.443662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:04.445111 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:04.447850 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 123/241] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:04.456647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:04.478946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66120e8b-420e-4752-a2c5-de30d29f8c63 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:04.520531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:04.537718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:04.545590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f227794-0078-4d97-917b-b62f05f3af18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:04.546712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227794-0078-4d97-917b-b62f05f3af18 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.547171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227794-0078-4d97-917b-b62f05f3af18 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.547621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f227794-0078-4d97-917b-b62f05f3af18 None admin] PATH_INFO: `/v3/users/3673952771104a5b8dddbc66280b53a2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.568567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f227794-0078-4d97-917b-b62f05f3af18 None admin] RBAC: Authorizing `identity:get_user(user_id=3673952771104a5b8dddbc66280b53a2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:04.570369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f227794-0078-4d97-917b-b62f05f3af18 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:04.572279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 119/242] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:04 2022] GET /identity/v3/users/3673952771104a5b8dddbc66280b53a2 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:04.574319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adca0a-bfb2-496f-942e-17d2315d9540 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.574799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adca0a-bfb2-496f-942e-17d2315d9540 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.575714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adca0a-bfb2-496f-942e-17d2315d9540 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.582029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 120/243] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:04.582338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adca0a-bfb2-496f-942e-17d2315d9540 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:04.612570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ec9a3-700a-4c6c-a776-9c14161cbd7e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:04.648484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b3eaf-522b-4584-848b-10ddac539153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:04.649253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b3eaf-522b-4584-848b-10ddac539153 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.649572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b3eaf-522b-4584-848b-10ddac539153 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.649851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b3eaf-522b-4584-848b-10ddac539153 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.650563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b3eaf-522b-4584-848b-10ddac539153 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:04.652871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b3eaf-522b-4584-848b-10ddac539153 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:04.677538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 124/244] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:04 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:04.677538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee20f99-c310-42ea-8780-5606f2aadfde None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.677538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee20f99-c310-42ea-8780-5606f2aadfde None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.677538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee20f99-c310-42ea-8780-5606f2aadfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.702379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cee20f99-c310-42ea-8780-5606f2aadfde None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:04.703522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cee20f99-c310-42ea-8780-5606f2aadfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:04.712243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adca0a-bfb2-496f-942e-17d2315d9540 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:04.758274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:04.759324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.759755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.760209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.799374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 125/245] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:04.801577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0514e8-bd1c-4e4b-ae57-22e122f9ac0b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.801577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0514e8-bd1c-4e4b-ae57-22e122f9ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.801577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0514e8-bd1c-4e4b-ae57-22e122f9ac0b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.802658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 126/246] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:04.808921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec0a0-f806-4432-af18-41928582b44f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:04.809225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec0a0-f806-4432-af18-41928582b44f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:04.809520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ec0a0-f806-4432-af18-41928582b44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:04.828484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-981ec0a0-f806-4432-af18-41928582b44f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:04.830106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-981ec0a0-f806-4432-af18-41928582b44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:04.846203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:04.859477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:04.877186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:04.878554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:04.921616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 127/247] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:04.922480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ec0a0-f806-4432-af18-41928582b44f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.008707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 121/248] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:05.009677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.052840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ec0a0-f806-4432-af18-41928582b44f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:05.098369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:05.098981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:05.099263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:05.099536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:05.116748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:05.120464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:05.127888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:05.128887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:05.129746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 128/249] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:05.130382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9ce86-cdeb-46d8-b466-b74da38fa743 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:05.131621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.147953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:05.183961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:05.185189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:05.185713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:05.187102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:05.202099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:05.212822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:05.214191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:05.215213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 122/250] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:05.216544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.273622 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf42ba-e5d0-4854-8789-3d984af5605f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:05.319478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:05.320348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:05.320629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:05.320900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:05.326701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:05.329567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:05.331499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 129/251] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:05.332103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.378196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cceab-12ec-4166-a818-4da358c72c23 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:05.419564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:05.420242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:05.420525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:05.420798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:05.421582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:05.421900 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:05.423279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:05.452340 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 123/252] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:05.453396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.482624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:05.500861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:05.548067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d9dd7-462f-4d2e-89bd-dbe180417471 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:05.601356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854892-4181-4b2a-8a62-7e0b8648dd3d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:05.625491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:05.626172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:05.626460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:05.626741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:05.627498 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:05.627804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:05.629188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:05.648899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 130/253] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:05.649801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.661829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:05.662501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:05.662781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:05.663057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:05.663898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] RBAC: Adding query filter params (role.id=8054996023414698bb5845c03d2c1751, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=3673952771104a5b8dddbc66280b53a2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:05.664209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:05.670076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:05.679677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 124/254] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/role_assignments?user.id=3673952771104a5b8dddbc66280b53a2&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=8054996023414698bb5845c03d2c1751 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:05.682173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.826234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85e93f-bb22-4496-ae3a-a593b835d567 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:05.869256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:05.871029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:05.872127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:05.872420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] PATH_INFO: `/v3/users/9087ae08bf64499597888d5c5937ceb0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:05.873779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=9087ae08bf64499597888d5c5937ceb0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:05.875557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:05.877556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 131/255] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/users/9087ae08bf64499597888d5c5937ceb0 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:05.884563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:05.896726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:05.903578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:05.951933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e190-c584-44b4-be2b-e48cebbe12ac None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:06.004015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b78951-d97b-43bb-889b-16b9c58768c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:06.005011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78951-d97b-43bb-889b-16b9c58768c1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.005295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78951-d97b-43bb-889b-16b9c58768c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.005598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78951-d97b-43bb-889b-16b9c58768c1 None admin] PATH_INFO: `/v3/users/38bfb83a81934c0ea530c7f84add42a0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.006937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b78951-d97b-43bb-889b-16b9c58768c1 None admin] RBAC: Authorizing `identity:get_user(user_id=38bfb83a81934c0ea530c7f84add42a0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:06.008503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b78951-d97b-43bb-889b-16b9c58768c1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:06.010326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 125/256] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/users/38bfb83a81934c0ea530c7f84add42a0 => generated 297 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:06.011883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaacb2-0341-45e4-9fb5-2b135c4f11f8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.012175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaacb2-0341-45e4-9fb5-2b135c4f11f8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.012450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcaacb2-0341-45e4-9fb5-2b135c4f11f8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.013934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 126/257] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:06.018720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaacb2-0341-45e4-9fb5-2b135c4f11f8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:06.020802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94ea17-1326-4cb8-b04a-064f20854aa2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:06.092195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:06.093104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.093623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.094092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.131288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcaacb2-0341-45e4-9fb5-2b135c4f11f8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:06.168040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9922b-33af-481f-9d48-77c9923c9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:06.168973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9922b-33af-481f-9d48-77c9923c9d28 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.169265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9922b-33af-481f-9d48-77c9923c9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.169622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9922b-33af-481f-9d48-77c9923c9d28 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.173365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9922b-33af-481f-9d48-77c9923c9d28 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:06.173365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9922b-33af-481f-9d48-77c9923c9d28 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:06.174887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 127/258] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:06 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:06.176218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee78b9-5569-4ba5-94be-3735959eab8f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.176540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee78b9-5569-4ba5-94be-3735959eab8f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.176898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee78b9-5569-4ba5-94be-3735959eab8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.198923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4bee78b9-5569-4ba5-94be-3735959eab8f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:06.205359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4bee78b9-5569-4ba5-94be-3735959eab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:06.235447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:06.275912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 128/259] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:06.282934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee78b9-5569-4ba5-94be-3735959eab8f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:06.284806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:06.286665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:06.313870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:06.463422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee78b9-5569-4ba5-94be-3735959eab8f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:06.510923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 132/260] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:06.511820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:06.537608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:06.538507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.538787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.539063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/38bfb83a81934c0ea530c7f84add42a0/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.544083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9850d74b2443dda42cfa15e364b370, user_id=38bfb83a81934c0ea530c7f84add42a0, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:06.545580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:06.570227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 129/261] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:06 2022] PUT /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/38bfb83a81934c0ea530c7f84add42a0/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:06.571481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:06.580486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:06.654274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182ad66-2cd0-4111-9667-d89a81b96631 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:06.668610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:06.701464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a098874-d279-4874-aab5-0262049ccace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:06.702789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a098874-d279-4874-aab5-0262049ccace None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.703227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a098874-d279-4874-aab5-0262049ccace None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.704118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a098874-d279-4874-aab5-0262049ccace None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.719049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a098874-d279-4874-aab5-0262049ccace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7a098874-d279-4874-aab5-0262049ccace None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:06.739648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:06.740870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:06.741908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:06.743864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 133/262] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:06.752220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a098874-d279-4874-aab5-0262049ccace None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:06.823386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a13ed-a560-4887-a572-d3a6c1d80218 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:06.899429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:06.902591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:06.903029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:06.903455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:06.909542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:06.911197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:06.913100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 130/263] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:06 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:06.942619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a098874-d279-4874-aab5-0262049ccace None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:06.951904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:07.018938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:07.019870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.020387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.020806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.021743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:07.023157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:07.024802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:07.040716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 134/264] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:07.042373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:07.085715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:07.123323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:07.177519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b0d9d-5e92-405a-8d93-1f98a36dc093 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:07.250741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d49771-9c75-49bc-a481-6abb7f96fa19 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:07.251722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:07.252634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.253113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.253637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.254679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=9087ae08bf64499597888d5c5937ceb0) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:07.255189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:07.256853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:07.273240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 131/265] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:06 2022] GET /identity/v3/role_assignments?user.id=9087ae08bf64499597888d5c5937ceb0&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:07.322125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b642c-0280-4501-9949-b27aaf71aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:07.323068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b642c-0280-4501-9949-b27aaf71aed1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.323410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b642c-0280-4501-9949-b27aaf71aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.323900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b642c-0280-4501-9949-b27aaf71aed1 None admin] PATH_INFO: `/v3/users/9087ae08bf64499597888d5c5937ceb0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.325388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b642c-0280-4501-9949-b27aaf71aed1 None admin] RBAC: Authorizing `identity:get_user(user_id=9087ae08bf64499597888d5c5937ceb0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:07.326854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b642c-0280-4501-9949-b27aaf71aed1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:07.328773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 135/266] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:07 2022] GET /identity/v3/users/9087ae08bf64499597888d5c5937ceb0 => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:07.334870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:07.528992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaca52f-c47c-4f62-8186-729d7837a7ac None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:07.568796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b526ee7-dd77-4b4f-b655-ece702ad5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:07.569473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526ee7-dd77-4b4f-b655-ece702ad5d3e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.569754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526ee7-dd77-4b4f-b655-ece702ad5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.570029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b526ee7-dd77-4b4f-b655-ece702ad5d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.574268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:07.675046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526ee7-dd77-4b4f-b655-ece702ad5d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:07.676536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b526ee7-dd77-4b4f-b655-ece702ad5d3e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:07.700869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8f34-f66c-4bbb-b553-2d44ebe69a1c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.701839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8f34-f66c-4bbb-b553-2d44ebe69a1c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.702318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d8f34-f66c-4bbb-b553-2d44ebe69a1c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.704158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 136/267] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:07.710202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16f09b-f6d4-48d5-8bb3-21aa9defca77 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.710736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16f09b-f6d4-48d5-8bb3-21aa9defca77 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.711212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16f09b-f6d4-48d5-8bb3-21aa9defca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.730384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5d16f09b-f6d4-48d5-8bb3-21aa9defca77 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:07.732654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d16f09b-f6d4-48d5-8bb3-21aa9defca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:07.806750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 132/268] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:07.809296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30242ad-ff3a-4159-b305-5180513bc770 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.810027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30242ad-ff3a-4159-b305-5180513bc770 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.810479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30242ad-ff3a-4159-b305-5180513bc770 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.812625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 133/269] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:07.813543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30242ad-ff3a-4159-b305-5180513bc770 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:07.841370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 137/270] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:07.841370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1563-ce70-4ffb-938b-a419486cdc5c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:07.841370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1563-ce70-4ffb-938b-a419486cdc5c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:07.841370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a1563-ce70-4ffb-938b-a419486cdc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:07.872313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-633a1563-ce70-4ffb-938b-a419486cdc5c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:07.873549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-633a1563-ce70-4ffb-938b-a419486cdc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:07.886605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:07.906918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:07.965646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 138/271] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:07.966780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1563-ce70-4ffb-938b-a419486cdc5c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:07.986442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30242ad-ff3a-4159-b305-5180513bc770 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.041058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.042981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.043968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.044481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.046417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:08.048798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:08.051678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 134/272] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:07 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:08.052944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.102374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a1563-ce70-4ffb-938b-a419486cdc5c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.142626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.143473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.143759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.144033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.145199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:08.146704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:08.148334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 139/273] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:08.153394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.188909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:08.196481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93750f1-029e-40bf-a4b3-36cfdf0f34c8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.198673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:08.237502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.238668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.239099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.239617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.255672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:08.267368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:08.268385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:08.269293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:08.271314 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 135/274] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:08.272828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.299714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bfab4-3152-4b67-b24b-a3458b7b1988 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.346517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.347097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.347383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.347660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.348503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] RBAC: Adding query filter params (role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=9087ae08bf64499597888d5c5937ceb0) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:08.348823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:08.350333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:08.365376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 140/275] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:08 2022] GET /identity/v3/role_assignments?user.id=9087ae08bf64499597888d5c5937ceb0&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=0778d0e990d0435eaff002965dc033ca => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:08.365376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.418304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a7f1c-7553-47d9-a5be-a6606f80f4f0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.460837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e4cd0-024f-42ed-bc4a-0dbdc3578227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.461577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e4cd0-024f-42ed-bc4a-0dbdc3578227 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.461861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e4cd0-024f-42ed-bc4a-0dbdc3578227 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.462139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e4cd0-024f-42ed-bc4a-0dbdc3578227 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.462533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:08.464238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e4cd0-024f-42ed-bc4a-0dbdc3578227 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:08.465903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e4cd0-024f-42ed-bc4a-0dbdc3578227 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:08.475393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bee40-dea2-4fc1-a15e-9694431e71ed None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.493098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 136/276] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:08 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:08.495365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06a189-b710-49c6-8254-5f4a198ee468 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.495971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06a189-b710-49c6-8254-5f4a198ee468 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.496457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06a189-b710-49c6-8254-5f4a198ee468 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.498087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 137/277] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:08.504003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b8150-2031-44d7-9b5d-e38a5b1af556 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.504626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b8150-2031-44d7-9b5d-e38a5b1af556 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.505140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b8150-2031-44d7-9b5d-e38a5b1af556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.524578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cf9b8150-2031-44d7-9b5d-e38a5b1af556 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:08.524771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.525418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.525709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.526021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.526805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:08.527115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:08.527545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cf9b8150-2031-44d7-9b5d-e38a5b1af556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:08.528717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:08.542821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 141/278] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:08.547787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:08.549749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.612901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 138/279] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:08.639153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b8150-2031-44d7-9b5d-e38a5b1af556 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.677035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2e4ea-f2d7-410b-b466-965f6800f699 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.718240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.719121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.719408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.719683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] PATH_INFO: `/v3/users/319a859904814a36833095985cd2acf1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.739335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] RBAC: Authorizing `identity:get_user(user_id=319a859904814a36833095985cd2acf1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:08.739335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:08.741288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 142/280] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:08 2022] GET /identity/v3/users/319a859904814a36833095985cd2acf1 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:08.747478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.763564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:08.771318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b8150-2031-44d7-9b5d-e38a5b1af556 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.813265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.814096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.814378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.814653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.830042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:08.841315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:08.842245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:08.843012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:08.843601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 139/281] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:08.855070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:08.869151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:08.884761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb37ba3-1722-49f6-b1fe-4eb7bfb2fc05 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:08.936674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:08.937485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:08.937656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:08.937929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:08.938773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, user.id=319a859904814a36833095985cd2acf1, scope.system=all) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:08.939237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:08.940526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:08.946296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 143/282] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 13:54:08 2022] GET /identity/v3/role_assignments?user.id=319a859904814a36833095985cd2acf1&scope.system=all&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:08.982529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0293-4a48-4e3f-bef6-31301310b246 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:09.023625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:09.024308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.024590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.024860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.025663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:09.026071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:09.027742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:09.037989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 140/283] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:09.043791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:09.141002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:09.170061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dd3ed-de73-451b-b59c-5f32c8bd8a01 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:09.220781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267adf10-fcee-4022-b53f-29f2f91fffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:09.221929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267adf10-fcee-4022-b53f-29f2f91fffdf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.222355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267adf10-fcee-4022-b53f-29f2f91fffdf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.222772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267adf10-fcee-4022-b53f-29f2f91fffdf None admin] PATH_INFO: `/v3/users/3673952771104a5b8dddbc66280b53a2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.230871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267adf10-fcee-4022-b53f-29f2f91fffdf None admin] RBAC: Authorizing `identity:get_user(user_id=3673952771104a5b8dddbc66280b53a2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:09.232607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267adf10-fcee-4022-b53f-29f2f91fffdf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:09.234532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 144/284] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:09 2022] GET /identity/v3/users/3673952771104a5b8dddbc66280b53a2 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:09.240232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:09.264104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3225-e98a-4e7d-8fc6-260174d60295 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.264652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3225-e98a-4e7d-8fc6-260174d60295 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.265075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3225-e98a-4e7d-8fc6-260174d60295 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.266934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 145/285] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:09.271877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1b04-a86b-406f-a753-240802bead8b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.272165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1b04-a86b-406f-a753-240802bead8b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.272445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1b04-a86b-406f-a753-240802bead8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.290459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d22f1b04-a86b-406f-a753-240802bead8b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:09.292204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d22f1b04-a86b-406f-a753-240802bead8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:09.367913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 146/286] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:09.379897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:09.406002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f1b04-a86b-406f-a753-240802bead8b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:09.437903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487373d7-273c-4334-8a28-24949cbd257f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:09.509302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:09.510201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.511093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.511515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.513017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:09.514588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:09.516529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 141/287] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:09 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:09.521865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:09.534276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:09.595725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f1b04-a86b-406f-a753-240802bead8b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:09.633184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f7185-79a5-49f5-a34a-dcb8f12f845a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:09.669407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:09.670565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.670815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:09.671352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.671701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.671982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.672259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/3673952771104a5b8dddbc66280b53a2/roles/8054996023414698bb5845c03d2c1751` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.672371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.675208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9850d74b2443dda42cfa15e364b370, user_id=3673952771104a5b8dddbc66280b53a2, role_id=8054996023414698bb5845c03d2c1751)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:09.675764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:09.686105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:09.692461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 142/288] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:09 2022] PUT /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370/users/3673952771104a5b8dddbc66280b53a2/roles/8054996023414698bb5845c03d2c1751 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:54:09.706556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:09.715385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:09.716357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:09.717184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 147/289] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:09.722653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:09.865511 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5871-fa96-491e-92a8-5cfc4f5a0f70 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:09.905479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:09.906466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:09.906927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:09.907376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:09.908309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:09.908890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:09.910517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:09.920782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 143/290] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:09.930502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:10.072490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094191c4-3b36-4708-b6c3-30ab21ff3b89 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:10.105381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:10.119071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:10.120025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:10.120377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:10.120656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] PATH_INFO: `/v3/users/38bfb83a81934c0ea530c7f84add42a0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:10.122024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] RBAC: Authorizing `identity:get_user(user_id=38bfb83a81934c0ea530c7f84add42a0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:10.123513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:10.125508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 148/291] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:09 2022] GET /identity/v3/users/38bfb83a81934c0ea530c7f84add42a0 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:10.130935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:10.212980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:10.277335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473d6e-d226-40ab-a778-ee0b4934b195 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:10.335175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:10.335870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:10.336171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:10.336450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:10.457064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:10.458658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:10.547906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:10.594130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 144/292] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:10.602422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:10.716428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253fa24-d488-45e0-a156-0f15799a3555 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:10.752160 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732a527-16d5-4c44-9444-a20695d8d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:10.753025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a527-16d5-4c44-9444-a20695d8d19a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:10.753308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a527-16d5-4c44-9444-a20695d8d19a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:10.753658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a527-16d5-4c44-9444-a20695d8d19a None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:10.754907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732a527-16d5-4c44-9444-a20695d8d19a None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:10.756372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732a527-16d5-4c44-9444-a20695d8d19a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:10.758473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 149/293] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:10 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:10.770475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:10.918073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f5b7c-fe9c-4c53-be48-414f43cbe06b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:10.973391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fb0c3-f182-4a10-8815-977a35a1db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:10.974058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb0c3-f182-4a10-8815-977a35a1db04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:10.974337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb0c3-f182-4a10-8815-977a35a1db04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:10.974609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fb0c3-f182-4a10-8815-977a35a1db04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:10.975492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fb0c3-f182-4a10-8815-977a35a1db04 None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=38bfb83a81934c0ea530c7f84add42a0) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:10.975806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fb0c3-f182-4a10-8815-977a35a1db04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:10.977249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fb0c3-f182-4a10-8815-977a35a1db04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:10.990290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 145/294] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:10 2022] GET /identity/v3/role_assignments?user.id=38bfb83a81934c0ea530c7f84add42a0&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:11.339217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7d8e-0886-4495-9de0-e82f25c864b1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.339793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7d8e-0886-4495-9de0-e82f25c864b1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.340079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d7d8e-0886-4495-9de0-e82f25c864b1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.342114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 150/295] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:11.347462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034db9b-94c3-4048-a2f6-dce25d5a434b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.347908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034db9b-94c3-4048-a2f6-dce25d5a434b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.348264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034db9b-94c3-4048-a2f6-dce25d5a434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.370027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0034db9b-94c3-4048-a2f6-dce25d5a434b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:11.371423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0034db9b-94c3-4048-a2f6-dce25d5a434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:11.392587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:11.409985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227468e9-41da-4f95-a83f-178b54b8421d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.410280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227468e9-41da-4f95-a83f-178b54b8421d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.410558 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227468e9-41da-4f95-a83f-178b54b8421d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.412110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 151/296] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:11.417514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9ff4-5b5d-48f9-bef8-28c2e3fd6320 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.417903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9ff4-5b5d-48f9-bef8-28c2e3fd6320 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.418269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9ff4-5b5d-48f9-bef8-28c2e3fd6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.443960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-478e9ff4-5b5d-48f9-bef8-28c2e3fd6320 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:11.445518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-478e9ff4-5b5d-48f9-bef8-28c2e3fd6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:11.457084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 146/297] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:11.485029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034db9b-94c3-4048-a2f6-dce25d5a434b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:11.519132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:11.526580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 152/298] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:11.553012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e9ff4-5b5d-48f9-bef8-28c2e3fd6320 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:11.594639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034db9b-94c3-4048-a2f6-dce25d5a434b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:11.630959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d515f-ad09-4eac-997d-23a400642d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:11.631759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d515f-ad09-4eac-997d-23a400642d9b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.632040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d515f-ad09-4eac-997d-23a400642d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.632319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d515f-ad09-4eac-997d-23a400642d9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.643477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d515f-ad09-4eac-997d-23a400642d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-381d515f-ad09-4eac-997d-23a400642d9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:11.652023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:11.652902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:11.653701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 147/299] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:11.654847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651905c5-732c-4d6e-b960-be05c3935291 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.654847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651905c5-732c-4d6e-b960-be05c3935291 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.655134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651905c5-732c-4d6e-b960-be05c3935291 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.656395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 148/300] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:11.661227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651905c5-732c-4d6e-b960-be05c3935291 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:11.669915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e9ff4-5b5d-48f9-bef8-28c2e3fd6320 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:11.678967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:11.706802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b1e18-0b7c-49b7-a5ea-018d115792f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:11.707595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b1e18-0b7c-49b7-a5ea-018d115792f4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.707882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b1e18-0b7c-49b7-a5ea-018d115792f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.708165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b1e18-0b7c-49b7-a5ea-018d115792f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.709333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b1e18-0b7c-49b7-a5ea-018d115792f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:11.710803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b1e18-0b7c-49b7-a5ea-018d115792f4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:11.712430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 153/301] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:11.715994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051119-5d88-414a-86cf-31807338eb42 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.716282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051119-5d88-414a-86cf-31807338eb42 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.716562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051119-5d88-414a-86cf-31807338eb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.733829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-83051119-5d88-414a-86cf-31807338eb42 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:11.735000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-83051119-5d88-414a-86cf-31807338eb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:11.783689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651905c5-732c-4d6e-b960-be05c3935291 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:11.801988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:11.810460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 154/302] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:11.811460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051119-5d88-414a-86cf-31807338eb42 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:11.826954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:11.828231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.828880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.829264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.830391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:11.830787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:11.832959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:11.842846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 149/303] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:11.843521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:11.926488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:11.926826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051119-5d88-414a-86cf-31807338eb42 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:11.954521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe6203-c569-4af0-b4a5-78786136f890 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:11.967387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:11.968061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:11.968350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:11.968626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] PATH_INFO: `/v3/groups` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:11.969318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:11.970793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:11.985809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 155/304] 10.222.0.76 () {60 vars in 1134 bytes} [Mon Jul 18 13:54:11 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:11.986618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.012851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.013826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.014109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.014526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.027795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:12.036609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:12.037587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:12.038342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 150/305] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:12.046255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.070697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:12.132697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48480d9-5c32-432a-81d0-474391f0aa82 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:12.175783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.176735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.177238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.177238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] PATH_INFO: `/v3/users/c8440aa550cb4ff3b8a2b791035b3c29` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.195527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] RBAC: Authorizing `identity:get_user(user_id=c8440aa550cb4ff3b8a2b791035b3c29)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:12.197000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:12.198969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 156/306] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:11 2022] GET /identity/v3/users/c8440aa550cb4ff3b8a2b791035b3c29 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:12.205019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.207004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbc615-7f2d-4f5c-871f-7e2bbeead8ae None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:12.257489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21735d7e-7133-4143-91d7-758dfaa27e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.259093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21735d7e-7133-4143-91d7-758dfaa27e86 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.259592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21735d7e-7133-4143-91d7-758dfaa27e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.261162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21735d7e-7133-4143-91d7-758dfaa27e86 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.262632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21735d7e-7133-4143-91d7-758dfaa27e86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:12.263295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21735d7e-7133-4143-91d7-758dfaa27e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:12.265372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21735d7e-7133-4143-91d7-758dfaa27e86 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:12.269099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:12.282843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 151/307] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:12.282843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56728a35-6081-49ff-991b-bd0377ba491d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.282843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56728a35-6081-49ff-991b-bd0377ba491d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.282843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56728a35-6081-49ff-991b-bd0377ba491d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.282843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 152/308] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:12.286376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56728a35-6081-49ff-991b-bd0377ba491d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.326886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845ef5-bff4-4627-990e-e88e669a4d0c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:12.341857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:12.364658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2522ae-e701-4991-9c8f-d88a365b3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.365314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2522ae-e701-4991-9c8f-d88a365b3d05 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.365639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2522ae-e701-4991-9c8f-d88a365b3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.365916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2522ae-e701-4991-9c8f-d88a365b3d05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.366755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2522ae-e701-4991-9c8f-d88a365b3d05 None admin] RBAC: Adding query filter params (role.id=8054996023414698bb5845c03d2c1751, user.id=c8440aa550cb4ff3b8a2b791035b3c29, scope.system=all) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:12.367090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2522ae-e701-4991-9c8f-d88a365b3d05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:12.368528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2522ae-e701-4991-9c8f-d88a365b3d05 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:12.374667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 157/309] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 13:54:12 2022] GET /identity/v3/role_assignments?user.id=c8440aa550cb4ff3b8a2b791035b3c29&scope.system=all&role.id=8054996023414698bb5845c03d2c1751 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:12.375704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520421-383d-4c65-8390-e7acc6cba10e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.375990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520421-383d-4c65-8390-e7acc6cba10e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.376266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520421-383d-4c65-8390-e7acc6cba10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.400369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-71520421-383d-4c65-8390-e7acc6cba10e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:12.402956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-71520421-383d-4c65-8390-e7acc6cba10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:12.422266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56728a35-6081-49ff-991b-bd0377ba491d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:12.480368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.481781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.482214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.482689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] PATH_INFO: `/v3/users/319a859904814a36833095985cd2acf1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.483299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 158/310] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:12.489489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] RBAC: Authorizing `identity:get_user(user_id=319a859904814a36833095985cd2acf1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:12.489489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:12.493692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 153/311] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:12 2022] GET /identity/v3/users/319a859904814a36833095985cd2acf1 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:12.496215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520421-383d-4c65-8390-e7acc6cba10e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.506273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.583501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:12.621216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e8e4a-8759-4874-88b2-e02b20589acf None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:12.626632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520421-383d-4c65-8390-e7acc6cba10e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:12.640200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:12.659121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.660144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.660584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.660860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.671621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:12.673944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.674972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.675413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.675835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] PATH_INFO: `/v3/system/users/319a859904814a36833095985cd2acf1/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.677500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=319a859904814a36833095985cd2acf1, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:12.679051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:12.679548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:12.680586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:12.681661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 154/312] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:12.688182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.695252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 159/313] 10.222.0.76 () {58 vars in 1334 bytes} [Mon Jul 18 13:54:12 2022] PUT /identity/v3/system/users/319a859904814a36833095985cd2acf1/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:12.816536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fb5ea-e791-4b20-a3eb-a86be4db989e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:12.847576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:12.857894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:12.858840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:12.859294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:12.859716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:12.860624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:12.861076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:12.862720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:12.872829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 155/314] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:12.878566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:12.991890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf5c42-d8c8-4bc1-925d-afc122459dbb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:13.027330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:13.028203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:13.028480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:13.028753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] PATH_INFO: `/v3/users/3673952771104a5b8dddbc66280b53a2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:13.029982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] RBAC: Authorizing `identity:get_user(user_id=3673952771104a5b8dddbc66280b53a2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:13.031429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:13.033051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 160/315] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:12 2022] GET /identity/v3/users/3673952771104a5b8dddbc66280b53a2 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:13.038659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:13.149050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb825d4-82d5-4efd-b137-18372350d666 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:13.189639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:13.190304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:13.190594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:13.190871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:13.257476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:13.274359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:13.276506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:13.382356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 156/316] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:13.388793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:13.434617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:13.499693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960128c-d5d5-4f62-8717-eef18ff8c60f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:13.534523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5336123-6fd2-4342-b99e-24b9fab258ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:13.535478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5336123-6fd2-4342-b99e-24b9fab258ce None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:13.535758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5336123-6fd2-4342-b99e-24b9fab258ce None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:13.536031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5336123-6fd2-4342-b99e-24b9fab258ce None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:13.537217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5336123-6fd2-4342-b99e-24b9fab258ce None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:13.538673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5336123-6fd2-4342-b99e-24b9fab258ce None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:13.540531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 161/317] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:13 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:13.547005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:13.650993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:13.663570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37c427-2879-4b1c-9a3c-1354a0861160 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:13.700927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922aa73-a814-4551-8dd4-07a5d4c4b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:13.701613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922aa73-a814-4551-8dd4-07a5d4c4b57f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:13.701897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922aa73-a814-4551-8dd4-07a5d4c4b57f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:13.702174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922aa73-a814-4551-8dd4-07a5d4c4b57f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:13.703007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922aa73-a814-4551-8dd4-07a5d4c4b57f None admin] RBAC: Adding query filter params (role.id=8054996023414698bb5845c03d2c1751, scope.project.id=fa9850d74b2443dda42cfa15e364b370, user.id=3673952771104a5b8dddbc66280b53a2) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:13.703570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922aa73-a814-4551-8dd4-07a5d4c4b57f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:13.705027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922aa73-a814-4551-8dd4-07a5d4c4b57f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:13.711408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 157/318] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:13 2022] GET /identity/v3/role_assignments?user.id=3673952771104a5b8dddbc66280b53a2&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=8054996023414698bb5845c03d2c1751 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:14.194369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4da056-47ad-416c-b027-05df7de1f3e9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.194711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4da056-47ad-416c-b027-05df7de1f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.194932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4da056-47ad-416c-b027-05df7de1f3e9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.196351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 162/319] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:14.201709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac6094-88fb-472e-a17e-ddee6569e3cc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.202002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac6094-88fb-472e-a17e-ddee6569e3cc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.202282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac6094-88fb-472e-a17e-ddee6569e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.220057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-52ac6094-88fb-472e-a17e-ddee6569e3cc None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:14.221260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-52ac6094-88fb-472e-a17e-ddee6569e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:14.292535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 158/320] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:14.314566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4da056-47ad-416c-b027-05df7de1f3e9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:14.421165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4da056-47ad-416c-b027-05df7de1f3e9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:14.430567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:14.457905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246bfd83-bfb3-432a-bc1b-e2cec321e784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:14.458700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bfd83-bfb3-432a-bc1b-e2cec321e784 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.458981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bfd83-bfb3-432a-bc1b-e2cec321e784 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.459255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246bfd83-bfb3-432a-bc1b-e2cec321e784 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.460410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bfd83-bfb3-432a-bc1b-e2cec321e784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:14.461885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246bfd83-bfb3-432a-bc1b-e2cec321e784 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:14.464291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 163/321] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:14.469763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac6094-88fb-472e-a17e-ddee6569e3cc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:14.534383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ad8f-056a-40cc-8571-ab9d29cf0add None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.534825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ad8f-056a-40cc-8571-ab9d29cf0add None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.534929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940ad8f-056a-40cc-8571-ab9d29cf0add None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.536490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 164/322] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:14.541271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbaf55-00f3-4e7e-aeaf-5f616227b7c7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.541681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbaf55-00f3-4e7e-aeaf-5f616227b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.541989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbaf55-00f3-4e7e-aeaf-5f616227b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.556493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:14.559886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0bbbaf55-00f3-4e7e-aeaf-5f616227b7c7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:14.561188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0bbbaf55-00f3-4e7e-aeaf-5f616227b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:14.580570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac6094-88fb-472e-a17e-ddee6569e3cc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:14.616236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:14.616901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.617198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.617480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] PATH_INFO: `/v3/groups` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.618170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:14.620155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:14.636610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 159/323] 10.222.0.76 () {60 vars in 1134 bytes} [Mon Jul 18 13:54:14 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:14.641955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 165/324] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:14.664341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:14.774019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae5e16-bdc6-4e23-9710-0a6a89636543 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:14.811404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:14.812208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.812491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.812764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.823778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:14.824206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d7c96-c749-4307-bdac-47a0c253614f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.824500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d7c96-c749-4307-bdac-47a0c253614f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.824778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d7c96-c749-4307-bdac-47a0c253614f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.826353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 166/325] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:14.831612 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84df36b-6cc5-4b50-a361-f066077e6c67 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:14.831905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84df36b-6cc5-4b50-a361-f066077e6c67 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:14.831999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:14.832792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:14.833636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:14.834244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84df36b-6cc5-4b50-a361-f066077e6c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:14.837584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 160/326] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:14.839061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:14.843492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:14.850916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b84df36b-6cc5-4b50-a361-f066077e6c67 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:14.852342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b84df36b-6cc5-4b50-a361-f066077e6c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:14.940438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 167/327] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:14.964874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84df36b-6cc5-4b50-a361-f066077e6c67 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:14.972464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92598129-8558-44ff-8e9c-829436808d21 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:15.008877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:15.021700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:15.022685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:15.022965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:15.023238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:15.023993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:15.024347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:15.028892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:15.038593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 161/328] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:15.045312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:15.110379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84df36b-6cc5-4b50-a361-f066077e6c67 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:15.139548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:15.158743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:15.159555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:15.159836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:15.160144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:15.175132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:15.185963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:15.186853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:15.187621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:15.188204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 168/329] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:15.194598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:15.197382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d186-edf0-4cc9-8902-429de839fd1f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:15.242432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:15.243527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:15.243809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:15.244086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] PATH_INFO: `/v3/users/c8440aa550cb4ff3b8a2b791035b3c29` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:15.246306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] RBAC: Authorizing `identity:get_user(user_id=c8440aa550cb4ff3b8a2b791035b3c29)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:15.247786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:15.249891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 162/330] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:15 2022] GET /identity/v3/users/c8440aa550cb4ff3b8a2b791035b3c29 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:15.254968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:15.325710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:15.335118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac1500-7761-4ca9-895f-e029d4983ab7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:15.383784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:15.385600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:15.385865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:15.386331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:15.387740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:15.388283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:15.390011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:15.397326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5dc24-02fa-4401-818d-77661302e433 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:15.407600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 169/331] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:15.413866 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:15.441752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:15.457497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:15.458656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:15.458934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:15.459207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] PATH_INFO: `/v3/system/users/c8440aa550cb4ff3b8a2b791035b3c29/roles/8054996023414698bb5845c03d2c1751` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:15.461839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8440aa550cb4ff3b8a2b791035b3c29, role_id=8054996023414698bb5845c03d2c1751)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:15.463811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:15.478454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 163/332] 10.222.0.76 () {58 vars in 1334 bytes} [Mon Jul 18 13:54:15 2022] PUT /identity/v3/system/users/c8440aa550cb4ff3b8a2b791035b3c29/roles/8054996023414698bb5845c03d2c1751 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:54:15.559849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c3f46-af3a-4094-a339-63c70ed8ce19 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:15.606642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39784fde-c279-4ac2-8bc6-b8513bb5660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:15.607910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784fde-c279-4ac2-8bc6-b8513bb5660d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:15.608480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784fde-c279-4ac2-8bc6-b8513bb5660d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:15.608945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784fde-c279-4ac2-8bc6-b8513bb5660d None admin] PATH_INFO: `/v3/users/319a859904814a36833095985cd2acf1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:15.610520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39784fde-c279-4ac2-8bc6-b8513bb5660d None admin] RBAC: Authorizing `identity:get_user(user_id=319a859904814a36833095985cd2acf1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:15.612226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39784fde-c279-4ac2-8bc6-b8513bb5660d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:15.614576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 170/333] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:15 2022] GET /identity/v3/users/319a859904814a36833095985cd2acf1 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:15.621151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:15.770508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a51d5-2e55-4e48-baab-c88e1e134072 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:15.812038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb0d77-37b3-430b-8dd7-54c1c94edcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:15.812702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0d77-37b3-430b-8dd7-54c1c94edcdf None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:15.812988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0d77-37b3-430b-8dd7-54c1c94edcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:15.813261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0d77-37b3-430b-8dd7-54c1c94edcdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:15.814184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb0d77-37b3-430b-8dd7-54c1c94edcdf None admin] RBAC: Adding query filter params (role.id=4335b2432ea84f658c748de9ac9026d1, user.id=319a859904814a36833095985cd2acf1, scope.system=all) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:15.814498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb0d77-37b3-430b-8dd7-54c1c94edcdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:15.815936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb0d77-37b3-430b-8dd7-54c1c94edcdf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:15.829579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 164/334] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 13:54:15 2022] GET /identity/v3/role_assignments?user.id=319a859904814a36833095985cd2acf1&scope.system=all&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:17.306100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a3e7-fd74-4428-b8a8-7a7dfb0a68dc None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:17.306702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a3e7-fd74-4428-b8a8-7a7dfb0a68dc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:17.306702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52a3e7-fd74-4428-b8a8-7a7dfb0a68dc None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:17.308357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 171/335] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:17.313924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa9c4-bd80-42a0-a49b-f2437f597369 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:17.314377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa9c4-bd80-42a0-a49b-f2437f597369 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:17.314556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daa9c4-bd80-42a0-a49b-f2437f597369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:17.338958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-62daa9c4-bd80-42a0-a49b-f2437f597369 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:17.340654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-62daa9c4-bd80-42a0-a49b-f2437f597369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:17.409739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:17.434049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 165/336] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:17.470060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52a3e7-fd74-4428-b8a8-7a7dfb0a68dc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:17.514216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:17.610169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52a3e7-fd74-4428-b8a8-7a7dfb0a68dc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:17.651564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:17.652522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:17.652804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:17.653079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:17.671401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:17.679250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:17.680156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:17.680965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 172/337] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:17.686910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daa9c4-bd80-42a0-a49b-f2437f597369 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:17.829128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daa9c4-bd80-42a0-a49b-f2437f597369 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:17.870155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98902b8-3c99-436e-b3bd-deb87c8db293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:17.870722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98902b8-3c99-436e-b3bd-deb87c8db293 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:17.871012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98902b8-3c99-436e-b3bd-deb87c8db293 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:17.871283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98902b8-3c99-436e-b3bd-deb87c8db293 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:17.872118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98902b8-3c99-436e-b3bd-deb87c8db293 None admin] RBAC: Adding query filter params (name=member) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:17.872495 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98902b8-3c99-436e-b3bd-deb87c8db293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:17.877885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98902b8-3c99-436e-b3bd-deb87c8db293 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:17.887402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 166/338] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:17.892648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:18.032298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:18.048284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4b32-5a5f-470f-b689-1f5d61cc84b6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:18.074715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65056e1-2aed-459d-bc5b-f7dc4f8f6be8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.075008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65056e1-2aed-459d-bc5b-f7dc4f8f6be8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.075264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65056e1-2aed-459d-bc5b-f7dc4f8f6be8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.077461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 167/339] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:18.082651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c4ee-8be8-46fe-9d17-c1bb5b49d3f6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.082935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c4ee-8be8-46fe-9d17-c1bb5b49d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.083213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c4ee-8be8-46fe-9d17-c1bb5b49d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.111747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec556a-6684-4b1f-bd91-5ebc3d1b01a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:18.112406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec556a-6684-4b1f-bd91-5ebc3d1b01a7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.112694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec556a-6684-4b1f-bd91-5ebc3d1b01a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.112970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec556a-6684-4b1f-bd91-5ebc3d1b01a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.118405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5530c4ee-8be8-46fe-9d17-c1bb5b49d3f6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:18.120987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5530c4ee-8be8-46fe-9d17-c1bb5b49d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:18.217776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:18.254357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec556a-6684-4b1f-bd91-5ebc3d1b01a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:18.256563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec556a-6684-4b1f-bd91-5ebc3d1b01a7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:18.272005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 168/340] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:18.310829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530c4ee-8be8-46fe-9d17-c1bb5b49d3f6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:18.397207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:18.420369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 173/341] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:18.425570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf8858-8c7e-418e-a547-e40990a8fdc8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.426121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf8858-8c7e-418e-a547-e40990a8fdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.426603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf8858-8c7e-418e-a547-e40990a8fdc8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.428400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 174/342] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:18.429293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf8858-8c7e-418e-a547-e40990a8fdc8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:18.493752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530c4ee-8be8-46fe-9d17-c1bb5b49d3f6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:18.558145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224985ed-8b78-4693-889a-93f31b96e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:18.558974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224985ed-8b78-4693-889a-93f31b96e754 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.559241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224985ed-8b78-4693-889a-93f31b96e754 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.559510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224985ed-8b78-4693-889a-93f31b96e754 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.571129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf8858-8c7e-418e-a547-e40990a8fdc8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:18.575895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224985ed-8b78-4693-889a-93f31b96e754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-224985ed-8b78-4693-889a-93f31b96e754 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:18.596609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:18.597566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:18.598335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 169/343] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:18.599726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b8cd-5567-489c-a3d6-1ce445a4b761 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.599726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b8cd-5567-489c-a3d6-1ce445a4b761 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.599726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509b8cd-5567-489c-a3d6-1ce445a4b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.613720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:18.614924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.615419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.615897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.617293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:18.618958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:18.621726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 175/344] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:18 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:18.622738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:18.638582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3509b8cd-5567-489c-a3d6-1ce445a4b761 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:18.640018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3509b8cd-5567-489c-a3d6-1ce445a4b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:18.689125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:18.689715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:18.735306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91733378-fcf5-40d1-aa18-d40a4084b2ba None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:18.755668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 170/345] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:18.756536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b8cd-5567-489c-a3d6-1ce445a4b761 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:18.780745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:18.781531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.781810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.782088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:18.782844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:18.783148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:18.784532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:18.798003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 176/346] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:18.808941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:18.924692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8f5b2-b28b-4f2d-a4c0-265ab9df9b79 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:18.954006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:18.964657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509b8cd-5567-489c-a3d6-1ce445a4b761 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:18.971132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b865732-c8c6-4bec-a80e-40daee7489f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:18.971793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865732-c8c6-4bec-a80e-40daee7489f0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:18.972076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865732-c8c6-4bec-a80e-40daee7489f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:18.972351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865732-c8c6-4bec-a80e-40daee7489f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.004338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.005195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.005501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.005772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.013556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:19.014977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:19.016907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 171/347] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:18 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:19.017602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.057631 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:19.071327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b865732-c8c6-4bec-a80e-40daee7489f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:19.074813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b865732-c8c6-4bec-a80e-40daee7489f0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:19.153270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58114d-6458-400a-aeb2-83aa52280d3a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:19.201191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 177/348] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:19.202394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.203478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.203700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4544417-5a8c-4533-bc8b-476567047f64 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.203814 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.204071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.204515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4544417-5a8c-4533-bc8b-476567047f64 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.204989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4544417-5a8c-4533-bc8b-476567047f64 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.206801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 178/349] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:19.208208 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60288f-b3e6-47eb-b5cd-0c9e789bbad4 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.208689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60288f-b3e6-47eb-b5cd-0c9e789bbad4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.209166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60288f-b3e6-47eb-b5cd-0c9e789bbad4 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.210868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 179/350] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:19.211842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60288f-b3e6-47eb-b5cd-0c9e789bbad4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.219414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:19.225851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:19.226737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:19.227560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 172/351] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:19.228204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.234701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:19.347881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60288f-b3e6-47eb-b5cd-0c9e789bbad4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:19.358523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:19.373894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa92db6-6e97-411f-a4d5-6a25d47e622c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:19.398071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2a37d-235a-490f-84a9-8ed9da3312da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.399387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a37d-235a-490f-84a9-8ed9da3312da None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.399889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a37d-235a-490f-84a9-8ed9da3312da None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.400921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2a37d-235a-490f-84a9-8ed9da3312da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.402059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2a37d-235a-490f-84a9-8ed9da3312da None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:19.402606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2a37d-235a-490f-84a9-8ed9da3312da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:19.404262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2a37d-235a-490f-84a9-8ed9da3312da None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:19.410654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 180/352] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:19.412109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cde1-3ad8-486d-8fa9-0e128ab58068 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.412396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cde1-3ad8-486d-8fa9-0e128ab58068 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.412673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cde1-3ad8-486d-8fa9-0e128ab58068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.423959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d69bcd-5dfe-40a7-9947-96d859e678cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.425233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d69bcd-5dfe-40a7-9947-96d859e678cb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.425777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d69bcd-5dfe-40a7-9947-96d859e678cb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.426275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d69bcd-5dfe-40a7-9947-96d859e678cb None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.427892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d69bcd-5dfe-40a7-9947-96d859e678cb None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:19.429690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d69bcd-5dfe-40a7-9947-96d859e678cb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:19.433577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-61f6cde1-3ad8-486d-8fa9-0e128ab58068 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:19.434354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-61f6cde1-3ad8-486d-8fa9-0e128ab58068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:19.434898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 173/353] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:19.437031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d69ade-f8f3-4ec9-9106-75eee076abc9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.437560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d69ade-f8f3-4ec9-9106-75eee076abc9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.438185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d69ade-f8f3-4ec9-9106-75eee076abc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.460687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b8d69ade-f8f3-4ec9-9106-75eee076abc9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:19.462294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b8d69ade-f8f3-4ec9-9106-75eee076abc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:19.531377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 181/354] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:19.532587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cde1-3ad8-486d-8fa9-0e128ab58068 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.550496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 174/355] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:19.551034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d69ade-f8f3-4ec9-9106-75eee076abc9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.558016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:19.664901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:19.676622 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cde1-3ad8-486d-8fa9-0e128ab58068 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:19.683508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d69ade-f8f3-4ec9-9106-75eee076abc9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:19.726424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0993-cd7b-4273-88be-78f300887d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.726975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0993-cd7b-4273-88be-78f300887d3d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.727261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0993-cd7b-4273-88be-78f300887d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.727539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0993-cd7b-4273-88be-78f300887d3d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.728820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0993-cd7b-4273-88be-78f300887d3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:19.728820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0993-cd7b-4273-88be-78f300887d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:19.730412 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0993-cd7b-4273-88be-78f300887d3d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:19.740463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 182/356] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:19.741471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.741691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ae93-d0f4-42ce-9b8c-7ff0fe3a5705 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.741931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ae93-d0f4-42ce-9b8c-7ff0fe3a5705 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.742205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ae93-d0f4-42ce-9b8c-7ff0fe3a5705 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.742367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.742610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.742885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.743694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 183/357] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:19.745004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ae93-d0f4-42ce-9b8c-7ff0fe3a5705 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.748567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:19.750325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:19.752157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 175/358] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:19.753084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.843072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:19.874414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ae93-d0f4-42ce-9b8c-7ff0fe3a5705 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:19.883176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d8d7-6880-4b26-8de1-75d2c1c2e36e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:19.918142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.918965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.919245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.919515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.932929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:19.935629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb109746-a5ce-45e8-bf6d-f1b5bff4727c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:19.936459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109746-a5ce-45e8-bf6d-f1b5bff4727c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.936737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109746-a5ce-45e8-bf6d-f1b5bff4727c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.937009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb109746-a5ce-45e8-bf6d-f1b5bff4727c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:19.941264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:19.942157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:19.943137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 184/359] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:19.943776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:19.956977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb109746-a5ce-45e8-bf6d-f1b5bff4727c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fb109746-a5ce-45e8-bf6d-f1b5bff4727c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:19.964945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:19.966039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 13:54:19.967117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:19.967784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 176/360] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:19.968745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1917-5889-44b4-a10a-59d3f570905c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:19.969081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1917-5889-44b4-a10a-59d3f570905c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:19.969411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a1917-5889-44b4-a10a-59d3f570905c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:19.990997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ad2a1917-5889-44b4-a10a-59d3f570905c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:19.992879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ad2a1917-5889-44b4-a10a-59d3f570905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:20.009105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:20.096497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 177/361] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:20.097445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1917-5889-44b4-a10a-59d3f570905c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:20.100417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e4e47-7b5e-4820-93b0-b2c2a1425a9b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.141705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:20.149335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.150104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.150929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.151203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.234666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a1917-5889-44b4-a10a-59d3f570905c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.241200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:20.242677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:20.284022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.284945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.285233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.286340 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.287267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:20.287589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:20.289123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:20.302275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 178/362] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=0778d0e990d0435eaff002965dc033ca => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:20.302909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:20.321467 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:20.376554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 185/363] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:20.377462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:20.417286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:20.451538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1279286-39a0-4261-8b0a-050f3180ca89 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.502676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.503649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.504115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.504554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.505508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:20.506118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:20.507513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:20.521394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 179/364] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:20.521394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:20.529747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0c140-ad3c-4562-b516-bba2696ad331 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.568321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.568995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.569276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.569583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.570339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:20.570645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:20.573977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:20.584062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 186/365] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:20.584860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:20.608973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:20.648714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f716-1383-444b-b87c-039b0f69ee91 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.695997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.697482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.698141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.698523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.699423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:20.708678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83584e7e-a27a-4cf2-bb81-b66ac7878b3a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.716162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:20.731675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:20.732584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:20.733384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:20.737424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 180/366] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:20.739426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:20.757715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.758509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.758792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.759068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.760357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:20.761838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:20.765187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 187/367] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:20.770201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:20.881741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee5c65-3009-4a97-b8fc-da7cb2bef906 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.905243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364361e-77ea-48b5-a369-277fdaf60e54 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:20.918144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:20.924495 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.925155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.925489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.925767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.952738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:20.953952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:20.954229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:20.954505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] PATH_INFO: `/v3/users/c8440aa550cb4ff3b8a2b791035b3c29` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:20.955994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] RBAC: Authorizing `identity:get_user(user_id=c8440aa550cb4ff3b8a2b791035b3c29)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:20.957270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:20.959946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 188/368] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/users/c8440aa550cb4ff3b8a2b791035b3c29 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:20.966675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.002964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:21.018621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:21.020029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:21.102199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402da4d1-e498-4138-a1f0-6c1cda0ac572 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:21.153605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:21.154284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:21.154569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:21.154937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:21.155702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:21.156008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:21.157410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:21.168043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 181/369] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:21.169193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.172024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 189/370] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:21.172933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.203637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:21.276671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:21.280289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a79af-5f5c-4dbb-8f67-eda2409c3cc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:21.287036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4caa5-ac54-4fbf-8352-a5a4287147c4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:21.320768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:21.322817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:21.323334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:21.323841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:21.325245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:21.325388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:21.326005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:21.326289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:21.326585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:21.327512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] RBAC: Adding query filter params (role.id=8054996023414698bb5845c03d2c1751, user.id=c8440aa550cb4ff3b8a2b791035b3c29, scope.system=all) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:21.327828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:21.328400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:21.329788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:21.330800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 182/371] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:21 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:21.331904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.344575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 190/372] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 13:54:21 2022] GET /identity/v3/role_assignments?user.id=c8440aa550cb4ff3b8a2b791035b3c29&scope.system=all&role.id=8054996023414698bb5845c03d2c1751 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:21.345446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.465376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208df10-e195-4a0d-b4ce-c00959c0cfd6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:21.501143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:21.501837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:21.502121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:21.502411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:21.512101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:21.515610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818b6c-c692-4832-bd2b-afc64557a308 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:21.524276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:21.570952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:21.571762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:21.572668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:21.573056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:21.574769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:21.576230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:21.581629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 183/373] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:21 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:21.583484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.631701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:21.633197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:21.754269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce7799-66ee-4c1d-bf25-5fc403eb97a2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:21.801176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:21.801864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:21.802144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:21.802422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:21.803260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=fa9850d74b2443dda42cfa15e364b370) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:21.803565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:21.804455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 191/374] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:21.805442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:21.805753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.812221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 184/375] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:21 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:21.813033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:21.856431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:21.890582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:21.959961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082ed2d-5145-4126-a939-39d231ab82c5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:21.961106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5c1a9-d273-4360-8d51-49145ca87e90 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.012296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7b8b2-cca8-43c6-a263-8e83166a03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.013166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b8b2-cca8-43c6-a263-8e83166a03da None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.013488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b8b2-cca8-43c6-a263-8e83166a03da None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.013760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7b8b2-cca8-43c6-a263-8e83166a03da None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.014649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f1f4-da28-4e53-8cde-f43e2595b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.015038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b8b2-cca8-43c6-a263-8e83166a03da None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.016037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f1f4-da28-4e53-8cde-f43e2595b121 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.016527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f1f4-da28-4e53-8cde-f43e2595b121 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.016709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7b8b2-cca8-43c6-a263-8e83166a03da None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.017171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f1f4-da28-4e53-8cde-f43e2595b121 None admin] PATH_INFO: `/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.023156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 192/376] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:21 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:22.023156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3c90-136b-409b-b035-b91cc62a25ac None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.023156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3c90-136b-409b-b035-b91cc62a25ac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.023156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3c90-136b-409b-b035-b91cc62a25ac None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.023156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 193/377] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:22.024108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021f1f4-da28-4e53-8cde-f43e2595b121 None admin] RBAC: Authorizing `identity:get_project(project_id=9a4af5872a8c47a1a7622f9d72a65eeb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.024765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3c90-136b-409b-b035-b91cc62a25ac None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.026524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021f1f4-da28-4e53-8cde-f43e2595b121 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.030353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 185/378] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:21 2022] GET /identity/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:22.031892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da3452-d427-4be0-b8d4-d2606e894e01 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.032392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da3452-d427-4be0-b8d4-d2606e894e01 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.032857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da3452-d427-4be0-b8d4-d2606e894e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.060405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-71da3452-d427-4be0-b8d4-d2606e894e01 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:22.061685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-71da3452-d427-4be0-b8d4-d2606e894e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:22.154730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 186/379] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:22.155375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da3452-d427-4be0-b8d4-d2606e894e01 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.170386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3c90-136b-409b-b035-b91cc62a25ac None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.189801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:22.192530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:22.221371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.221371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.221371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.221721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.222435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=fa9850d74b2443dda42cfa15e364b370) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:22.222741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.225083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.234703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 194/380] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=0778d0e990d0435eaff002965dc033ca => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:22.236046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.284963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da3452-d427-4be0-b8d4-d2606e894e01 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.328337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.329261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.329586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.329860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] PATH_INFO: `/v3/groups/a529415983e948ab8e628911fb7be5cc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.335784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] RBAC: Authorizing `identity:get_group(group_id=a529415983e948ab8e628911fb7be5cc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.337732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.339868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 187/381] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/groups/a529415983e948ab8e628911fb7be5cc => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:22.346087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.373907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154f4e-c403-41d4-8b30-89798fcb07d0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.418224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.418947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.419224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.419497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.431904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:22.439874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:22.440783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:22.441611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 195/382] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:22.451572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.464415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:22.474651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f15afd-96b8-4a89-8662-6f731079498d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.499473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:22.513756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.514491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.514769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.515042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.516016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] RBAC: Adding query filter params (group.id=a529415983e948ab8e628911fb7be5cc, role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=9a4af5872a8c47a1a7622f9d72a65eeb) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:22.516329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.517803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.524267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 188/383] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/role_assignments?group.id=a529415983e948ab8e628911fb7be5cc&scope.project.id=9a4af5872a8c47a1a7622f9d72a65eeb&role.id=12c8bb015e454a52a54bf61032d11091 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:22.568680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92753b-93e9-4895-931d-26c07b841df9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.609227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114d5d3-01f3-4433-a1db-b8b1e174e0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.609948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d5d3-01f3-4433-a1db-b8b1e174e0ea None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.610224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d5d3-01f3-4433-a1db-b8b1e174e0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.610494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114d5d3-01f3-4433-a1db-b8b1e174e0ea None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.611267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d5d3-01f3-4433-a1db-b8b1e174e0ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:22.611569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d5d3-01f3-4433-a1db-b8b1e174e0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.612976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114d5d3-01f3-4433-a1db-b8b1e174e0ea None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.623654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 196/384] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:22.629463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.702882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e8ae1-594f-45b3-af26-7d8d583ee616 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.703440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e8ae1-594f-45b3-af26-7d8d583ee616 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.703613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e8ae1-594f-45b3-af26-7d8d583ee616 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.706200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 197/385] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:22.710764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d859-ce07-4ffc-b010-9ee6ea5d32b6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.711045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d859-ce07-4ffc-b010-9ee6ea5d32b6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.711320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08d859-ce07-4ffc-b010-9ee6ea5d32b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.730677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5d08d859-ce07-4ffc-b010-9ee6ea5d32b6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:22.732009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d08d859-ce07-4ffc-b010-9ee6ea5d32b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:22.753670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaae792-c983-4b0e-a831-0e7f1fa5b00e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.792849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.794564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.795075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.795609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.797089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.798768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.800909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 189/386] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:22.807040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.814000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 198/387] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:22.838830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:22.840176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d859-ce07-4ffc-b010-9ee6ea5d32b6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:22.881977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:22.946539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ec47b-96dc-40a7-8f25-bcbeb1930a70 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.959771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08d859-ce07-4ffc-b010-9ee6ea5d32b6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:22.991373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:22.992761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:22.993247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:22.993818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:22.995979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:22.997670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:22.999942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 190/388] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:23.008821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:23.038048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:23.038858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:23.039136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:23.039412 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:23.058552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:23.069805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:23.070695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:23.071474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 199/389] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:23.084430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:23.214724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:23.227809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13d0f-5455-4c4b-b1c3-4344e6f2695a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:23.245200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:23.257366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d14da-f1db-4655-b610-82d2ef76cbd3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:23.283677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:23.284901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:23.285329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:23.285794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:23.290055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=08803b5100bc4cd18199dfeeba2b7ab5, group_id=b5929971d5d74a9e8019d3ed52a35efe, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:23.291710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:23.292178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:23.292514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:23.292864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:23.293204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:23.294049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:23.294422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:23.295982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:23.309463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 200/390] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:23.311869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:23.329515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 191/391] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 13:54:23 2022] PUT /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:54:23.467297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09817de-f1a6-43da-9ee0-7a8cc9f4f519 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:23.519407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:23.520280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:23.520567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:23.520842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:23.522070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:23.523509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:23.525583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 201/392] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:23 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:23.533715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:23.689106 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a31195-5607-40da-991b-376e16cc54c8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:23.731862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111cd01-e002-4464-9177-f81ce31fe6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:23.732653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cd01-e002-4464-9177-f81ce31fe6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:23.732938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cd01-e002-4464-9177-f81ce31fe6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:23.733216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cd01-e002-4464-9177-f81ce31fe6a8 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:23.734487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111cd01-e002-4464-9177-f81ce31fe6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:23.736023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111cd01-e002-4464-9177-f81ce31fe6a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:23.737761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 192/393] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:23 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:23.743527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:23.770903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:23.855404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3974c7e-1ae2-4d06-893b-caf77dffb4f7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:23.891134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501af1e8-c2af-4de4-925b-34e76dd83987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:23.892023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af1e8-c2af-4de4-925b-34e76dd83987 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:23.892306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af1e8-c2af-4de4-925b-34e76dd83987 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:23.892591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501af1e8-c2af-4de4-925b-34e76dd83987 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:23.894889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501af1e8-c2af-4de4-925b-34e76dd83987 None admin] RBAC: Authorizing `identity:create_grant(project_id=08803b5100bc4cd18199dfeeba2b7ab5, group_id=b5929971d5d74a9e8019d3ed52a35efe, role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:23.896339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501af1e8-c2af-4de4-925b-34e76dd83987 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:23.911746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 202/394] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 13:54:23 2022] PUT /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/0778d0e990d0435eaff002965dc033ca => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:24.397181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb625c7-c02f-4240-b296-18650916020b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:24.397691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb625c7-c02f-4240-b296-18650916020b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:24.397691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb625c7-c02f-4240-b296-18650916020b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:24.399272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 193/395] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:24.404278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bec6dc-1a35-4dbf-a6b0-15b67c8040b5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:24.404832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bec6dc-1a35-4dbf-a6b0-15b67c8040b5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:24.405304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bec6dc-1a35-4dbf-a6b0-15b67c8040b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:24.426359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f1bec6dc-1a35-4dbf-a6b0-15b67c8040b5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:24.427859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f1bec6dc-1a35-4dbf-a6b0-15b67c8040b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:24.515757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 203/396] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:24.550872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb625c7-c02f-4240-b296-18650916020b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:24.580532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:24.694109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb625c7-c02f-4240-b296-18650916020b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:24.734107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:24.735529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:24.736016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:24.736493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:24.748437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:24.756766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:24.757679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:24.758471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:24.761284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 194/397] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:24.766670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bec6dc-1a35-4dbf-a6b0-15b67c8040b5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:24.783752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:24.885438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bec6dc-1a35-4dbf-a6b0-15b67c8040b5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:24.935183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b62f-4962-4b85-a390-5602d408936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:24.935868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b62f-4962-4b85-a390-5602d408936c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:24.936194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b62f-4962-4b85-a390-5602d408936c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:24.936479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b62f-4962-4b85-a390-5602d408936c None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:24.937232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b62f-4962-4b85-a390-5602d408936c None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:24.937582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b62f-4962-4b85-a390-5602d408936c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:24.938965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b62f-4962-4b85-a390-5602d408936c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:24.954433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 204/398] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:24.960385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:24.990454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24c485-93e8-4aac-8249-d938ff50bde9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:24.991119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24c485-93e8-4aac-8249-d938ff50bde9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:24.991644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24c485-93e8-4aac-8249-d938ff50bde9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:24.993524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 205/399] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:24.999535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba736-da50-4041-b0ea-daa2bfa2bcbb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.000092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba736-da50-4041-b0ea-daa2bfa2bcbb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.000572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba736-da50-4041-b0ea-daa2bfa2bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.018561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5aeba736-da50-4041-b0ea-daa2bfa2bcbb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:25.020092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5aeba736-da50-4041-b0ea-daa2bfa2bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:25.094455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.121562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 206/400] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:25.137705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f47a3e-c7be-4c39-b87d-6c5f1315ba4b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.140510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeba736-da50-4041-b0ea-daa2bfa2bcbb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.150348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.195145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7306ea-4954-4fb0-885e-a9e5253a1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.196360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7306ea-4954-4fb0-885e-a9e5253a1c26 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.197540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7306ea-4954-4fb0-885e-a9e5253a1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.198175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7306ea-4954-4fb0-885e-a9e5253a1c26 None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.199764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7306ea-4954-4fb0-885e-a9e5253a1c26 None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:25.201485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7306ea-4954-4fb0-885e-a9e5253a1c26 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:25.204295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 195/401] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:24 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:25.206030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6756a-9258-463d-9a29-6a97a9d54a66 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.206536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6756a-9258-463d-9a29-6a97a9d54a66 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.207074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6756a-9258-463d-9a29-6a97a9d54a66 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.209244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 196/402] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:25.210157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6756a-9258-463d-9a29-6a97a9d54a66 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.268523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeba736-da50-4041-b0ea-daa2bfa2bcbb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.305101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628d0de-cebd-4453-8295-fbe634b65d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.306090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d0de-cebd-4453-8295-fbe634b65d47 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.306465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d0de-cebd-4453-8295-fbe634b65d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.306746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628d0de-cebd-4453-8295-fbe634b65d47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.318011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628d0de-cebd-4453-8295-fbe634b65d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:25.325039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6756a-9258-463d-9a29-6a97a9d54a66 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d628d0de-cebd-4453-8295-fbe634b65d47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:25.327290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:25.328411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 207/403] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:25.335148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b595-f49c-451d-8ea4-2720e9187d8f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.335878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b595-f49c-451d-8ea4-2720e9187d8f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.335878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b595-f49c-451d-8ea4-2720e9187d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.354386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-20c0b595-f49c-451d-8ea4-2720e9187d8f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:25.356384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-20c0b595-f49c-451d-8ea4-2720e9187d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:25.373378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.374289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.374572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.374844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.376179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:25.378513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:25.380591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 197/404] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:25.381507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.405927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.440682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.453517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 208/405] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:25.458292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b595-f49c-451d-8ea4-2720e9187d8f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.508035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57860-7548-415f-8814-5632bbce03c2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.547552 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.548683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.549169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.549669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.550786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:25.551292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:25.552994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:25.568013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 198/406] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:25.569161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.574179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b595-f49c-451d-8ea4-2720e9187d8f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.608064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.609172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.609616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.610046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.612714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9850d74b2443dda42cfa15e364b370, group_id=b5929971d5d74a9e8019d3ed52a35efe, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:25.614347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:25.630138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 209/407] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 13:54:25 2022] PUT /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:25.631179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.669942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.695097 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a4186-b034-4097-bea6-ff9b06fd3500 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.697580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.738115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.739027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.739289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.739569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.748952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb0fac-3d26-4add-ac97-46be025f7bae None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.752598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:25.760975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:25.762063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:25.762823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 199/408] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:25.768714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.791092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.792686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.793168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.793714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.795241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:25.796985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:25.799324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 210/409] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:25.805551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.892946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dbbfe-3448-4e12-8d21-50e39c3da1f2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.916729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604221b-a651-4535-a830-d9735a4a0216 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:25.936132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.936132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.936132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.936132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.936531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:25.936531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:25.937313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:25.955544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.956770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 200/410] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:25.963507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:25.967344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:25.974415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:25.975293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:25.975576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:25.975856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:25.977572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:25.979544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:25.985375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 211/411] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:25.990348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:26.108569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af683ec5-49a8-4c25-b59b-01819c0288b4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:26.151298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:26.152168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.152453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.152733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] PATH_INFO: `/v3/groups/a529415983e948ab8e628911fb7be5cc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.158192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] RBAC: Authorizing `identity:get_group(group_id=a529415983e948ab8e628911fb7be5cc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:26.159662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:26.161541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 201/412] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:25 2022] GET /identity/v3/groups/a529415983e948ab8e628911fb7be5cc => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:26.185744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:26.227161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ca1b1-22e8-4e53-b015-6d7a8ec803a1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:26.274760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dea078-a562-4b40-805d-eb6eed7d99b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:26.275809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea078-a562-4b40-805d-eb6eed7d99b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.276134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea078-a562-4b40-805d-eb6eed7d99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.276411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dea078-a562-4b40-805d-eb6eed7d99b0 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.283813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dea078-a562-4b40-805d-eb6eed7d99b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa9850d74b2443dda42cfa15e364b370, group_id=b5929971d5d74a9e8019d3ed52a35efe, role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:26.285275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dea078-a562-4b40-805d-eb6eed7d99b0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:26.326005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 212/413] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 13:54:25 2022] PUT /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370/groups/b5929971d5d74a9e8019d3ed52a35efe/roles/0778d0e990d0435eaff002965dc033ca => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:54:26.328092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dc7a1-92b0-4a80-933c-cfb07106a895 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.328605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dc7a1-92b0-4a80-933c-cfb07106a895 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.329112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dc7a1-92b0-4a80-933c-cfb07106a895 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.332323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 213/414] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:26.339989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3fe27-195d-4b3b-a3d0-640401b86538 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.340816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3fe27-195d-4b3b-a3d0-640401b86538 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.342936 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3fe27-195d-4b3b-a3d0-640401b86538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.343096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:26.375809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-98a3fe27-195d-4b3b-a3d0-640401b86538 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:26.378138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-98a3fe27-195d-4b3b-a3d0-640401b86538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:26.393128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891cf00-62c4-49b2-842e-bba55d5f790a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:26.435437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ebefc-575a-4ac8-8f2b-2756b805ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:26.436385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ebefc-575a-4ac8-8f2b-2756b805ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.436673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ebefc-575a-4ac8-8f2b-2756b805ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.436959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ebefc-575a-4ac8-8f2b-2756b805ebfe None admin] PATH_INFO: `/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.438416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ebefc-575a-4ac8-8f2b-2756b805ebfe None admin] RBAC: Authorizing `identity:get_project(project_id=9a4af5872a8c47a1a7622f9d72a65eeb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:26.440117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ebefc-575a-4ac8-8f2b-2756b805ebfe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:26.445437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 202/415] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:26 2022] GET /identity/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb => generated 344 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:26.447249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:26.448571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e279a0c-443d-42b6-a7fe-2006de915a3a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.449854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e279a0c-443d-42b6-a7fe-2006de915a3a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.450230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e279a0c-443d-42b6-a7fe-2006de915a3a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.454058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 203/416] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:26.455140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e279a0c-443d-42b6-a7fe-2006de915a3a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:26.472711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 214/417] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:26.482756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7b275-8260-4f1c-9b8b-973ba6d7a510 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.483331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7b275-8260-4f1c-9b8b-973ba6d7a510 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.483789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7b275-8260-4f1c-9b8b-973ba6d7a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.502428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7bd7b275-8260-4f1c-9b8b-973ba6d7a510 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:26.503930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7bd7b275-8260-4f1c-9b8b-973ba6d7a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:26.581295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e279a0c-443d-42b6-a7fe-2006de915a3a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:26.592426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 215/418] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:26.593647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7b275-8260-4f1c-9b8b-973ba6d7a510 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:26.643330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:26.644223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.644501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.644789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] PATH_INFO: `/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb/groups/a529415983e948ab8e628911fb7be5cc/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.646963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a4af5872a8c47a1a7622f9d72a65eeb, group_id=a529415983e948ab8e628911fb7be5cc, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:26.648496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:26.661502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:26.668930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 204/419] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 13:54:26 2022] PUT /identity/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb/groups/a529415983e948ab8e628911fb7be5cc/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:26.670647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:26.716463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7b275-8260-4f1c-9b8b-973ba6d7a510 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:26.735716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:26.776950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:26.778073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.778363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.778640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.804400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:26.818935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:26.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:26.820665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 216/420] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:26.829778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:26.836914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea862e6-4b3f-47bc-85ae-d28fa890c692 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:26.898968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:26.900401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:26.902744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:26.903258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:26.915311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:26.924272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:26.925175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:26.925978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:26.928750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 205/421] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:26.938173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:27.005717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:27.059399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a7221-5fb1-4cc2-96a5-9ce42d83f52e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:27.092770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470898f-4dee-420e-bf5d-3a9ac69017cd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:27.139527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:27.140213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:27.140497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:27.140778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:27.141574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:27.141884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:27.143279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:27.163671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:27.164395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:27.164691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:27.164971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:27.168966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 217/422] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:27.169199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:27.174193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:27.175059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:27.176545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:27.194437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 206/423] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:27.201025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:27.213652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:27.289370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a82e4-f902-4bcd-820d-0b7de49ad558 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:27.321083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:27.322426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:27.322778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:27.323053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:27.395419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:27.396781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:27.431931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:27.454505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08079147-3712-4d7c-ae5d-b183c3f74d6d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:27.475111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:27.502527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:27.503263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:27.503472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:27.503753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:27.508218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 218/424] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:27.514127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:27.620015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd36e2b-ec02-443c-923c-507fa1714751 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:27.656992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:27.658106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:27.658524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:27.658957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:27.660300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:27.661905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:27.664004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 219/425] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:27 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:27.669564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:27.672486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:27.674946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:27.675916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:27.779338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f8ad-79af-4e2a-a616-0cf822e63d4d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:27.816113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:27.817678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:27.818130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:27.818539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:27.819874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:27.821477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:27.823681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 220/426] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:27 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:27.829769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:27.885257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 207/427] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 13:54:27.890779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:27.911136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:27.933694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:27.978304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629e462-cc11-4a8a-bed4-ea8a5cfcd6ce None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:28.023803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae29639-8122-4299-93b4-f606fe8d6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:28.024458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29639-8122-4299-93b4-f606fe8d6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.024764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29639-8122-4299-93b4-f606fe8d6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.025039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae29639-8122-4299-93b4-f606fe8d6ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.026040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae29639-8122-4299-93b4-f606fe8d6ae0 None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:28.026347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae29639-8122-4299-93b4-f606fe8d6ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:28.027930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae29639-8122-4299-93b4-f606fe8d6ae0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:28.034751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 221/428] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:27 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:28.131683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c456fe-a858-4811-bdf5-897fab851ac6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:28.180278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440301ed-c622-4047-a5d7-aa2a3bbbc81d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.180551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440301ed-c622-4047-a5d7-aa2a3bbbc81d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.180746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440301ed-c622-4047-a5d7-aa2a3bbbc81d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.182927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 222/429] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:28.186226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:28.187171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.187519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.187860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] PATH_INFO: `/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.189132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] RBAC: Authorizing `identity:get_project(project_id=08803b5100bc4cd18199dfeeba2b7ab5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:28.190752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:28.191461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539d6a-88c5-4d81-bd34-041c4bec6656 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.191760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539d6a-88c5-4d81-bd34-041c4bec6656 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.192043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539d6a-88c5-4d81-bd34-041c4bec6656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.192724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 208/430] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:27 2022] GET /identity/v3/projects/08803b5100bc4cd18199dfeeba2b7ab5 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:28.198419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:28.222850 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-df539d6a-88c5-4d81-bd34-041c4bec6656 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:28.226578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df539d6a-88c5-4d81-bd34-041c4bec6656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:28.325102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 223/431] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:28.342062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:28.358068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7c7fd-0062-4031-a671-6eff132dde30 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:28.362676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539d6a-88c5-4d81-bd34-041c4bec6656 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:28.403986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:28.404968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.405244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.405536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.406852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:28.409180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:28.410864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 209/432] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:28 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:28.419532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:28.474313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:28.523337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539d6a-88c5-4d81-bd34-041c4bec6656 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:28.561213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9a2d-5e13-4aff-b95c-010496865c6e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:28.581984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:28.582785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.583074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.583335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.608330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:28.619723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dd039-a00e-4606-942a-d26d315f0326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:28.620567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd039-a00e-4606-942a-d26d315f0326 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.620912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd039-a00e-4606-942a-d26d315f0326 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.621255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dd039-a00e-4606-942a-d26d315f0326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.622233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd039-a00e-4606-942a-d26d315f0326 None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:28.622458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:28.624077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 13:54:28.626083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:28.627192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd039-a00e-4606-942a-d26d315f0326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:28.628221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dd039-a00e-4606-942a-d26d315f0326 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:28.629138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 224/433] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:28.637089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:28.644094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 210/434] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:28 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=08803b5100bc4cd18199dfeeba2b7ab5&role.id=0778d0e990d0435eaff002965dc033ca => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:28.819947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16af18d-94a4-4700-b9bb-239d2b9d70dc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:28.851748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:28.859826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b063d5-04d8-48c5-8462-aa0990a8d42c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.860118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b063d5-04d8-48c5-8462-aa0990a8d42c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.860388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b063d5-04d8-48c5-8462-aa0990a8d42c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.862069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 211/435] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:28.866778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:28.867717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.867999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.868429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.868848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b51542-49cf-44ac-adff-fc8977227ee1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:28.869169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b51542-49cf-44ac-adff-fc8977227ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:28.869491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b51542-49cf-44ac-adff-fc8977227ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:28.869623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] RBAC: Adding query filter params (name=member) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:28.869882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:28.872104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:28.882173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 225/436] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:54:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:28.890544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:28.898991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-66b51542-49cf-44ac-adff-fc8977227ee1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:28.902019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-66b51542-49cf-44ac-adff-fc8977227ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:28.928241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:28.992856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 212/437] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:29.020753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b51542-49cf-44ac-adff-fc8977227ee1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.032661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106f38f-08cd-44ce-bbc2-9e33eb2f875d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.090858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80982e63-a8c6-4a51-b99c-25e1d8160751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.090858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80982e63-a8c6-4a51-b99c-25e1d8160751 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.090858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80982e63-a8c6-4a51-b99c-25e1d8160751 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.090858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80982e63-a8c6-4a51-b99c-25e1d8160751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.153190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:29.178236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80982e63-a8c6-4a51-b99c-25e1d8160751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:29.179691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80982e63-a8c6-4a51-b99c-25e1d8160751 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:29.203363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b51542-49cf-44ac-adff-fc8977227ee1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.240536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e116c0-92de-410f-8906-3fe2a1ee0185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.241373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e116c0-92de-410f-8906-3fe2a1ee0185 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.241657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e116c0-92de-410f-8906-3fe2a1ee0185 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.241932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e116c0-92de-410f-8906-3fe2a1ee0185 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.253131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e116c0-92de-410f-8906-3fe2a1ee0185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-45e116c0-92de-410f-8906-3fe2a1ee0185 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:29.262149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:29.263058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:29.263849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 213/438] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:29.265038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5769ec-b5fa-4c49-bada-f866291608d7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.265326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5769ec-b5fa-4c49-bada-f866291608d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.265627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5769ec-b5fa-4c49-bada-f866291608d7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.267078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 214/439] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:29.270166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5769ec-b5fa-4c49-bada-f866291608d7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.284657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:29.322251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 226/440] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:29.326003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42bbcd-2b3f-4e2b-9381-e3f629c5e7d6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.326003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42bbcd-2b3f-4e2b-9381-e3f629c5e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.326003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42bbcd-2b3f-4e2b-9381-e3f629c5e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.351768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8c42bbcd-2b3f-4e2b-9381-e3f629c5e7d6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:29.352930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8c42bbcd-2b3f-4e2b-9381-e3f629c5e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:29.398882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5769ec-b5fa-4c49-bada-f866291608d7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.430333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 227/441] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:29.432051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42bbcd-2b3f-4e2b-9381-e3f629c5e7d6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.444730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.445608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.445936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.446222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.447542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:29.447948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:29.449372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:29.453933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:29.460113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 215/442] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:29.462488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.538499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:29.546686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42bbcd-2b3f-4e2b-9381-e3f629c5e7d6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.569336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d426e-7ad6-4db3-a783-eb1bb9691fdb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.584132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.584995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.585281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.585621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.586801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:29.588592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:29.590319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 228/443] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:29.591082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.605257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.606082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.606369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.606645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.617377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:29.625727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:29.626619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:29.627385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 216/444] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:29.628028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.688658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:29.704897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19e17f-797f-4983-9bc1-1986f16d1bdb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.729904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad007ff-391f-4ddb-8155-51f068c1159a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.740519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.741169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.741485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.741760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.759431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:29.765398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.766240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.766518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.766791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.767966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:29.769435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:29.771045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 217/445] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:29.771793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.812657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:29.814148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:29.875539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12842bbb-02d4-4d4e-ba7c-5ac2f3e3462e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:29.897662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:29.910639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:29.911313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:29.911590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:29.911864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:29.912609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:29.912912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:29.914296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:29.915813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 229/446] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:29.918240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.922942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 218/447] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:29.923759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:29.985689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:30.018795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03347c92-e97a-4e68-8b90-f4b640dfa65a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.025415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601fe632-fb72-4cb9-b67d-f246b33402da None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.053849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.054495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.054776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.055053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.056409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=4335b2432ea84f658c748de9ac9026d1, scope.project.id=fa9850d74b2443dda42cfa15e364b370) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:30.056841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.058300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.058694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.059539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.059809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.060081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] PATH_INFO: `/v3/projects/fa9850d74b2443dda42cfa15e364b370` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.061241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] RBAC: Authorizing `identity:get_project(project_id=fa9850d74b2443dda42cfa15e364b370)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.062680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.064311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 230/448] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=4335b2432ea84f658c748de9ac9026d1 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:30.064435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 219/449] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:29 2022] GET /identity/v3/projects/fa9850d74b2443dda42cfa15e364b370 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:30.064925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:30.079833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:30.128515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:30.187059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36262e99-f84c-4076-bbff-14feb8b2346e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.200111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98a836-0b74-408f-91ae-fecf7e92eed5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.228701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.229491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.229775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.230053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.232602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:30.240204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.241059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.241772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.241772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] PATH_INFO: `/v3/groups/b5929971d5d74a9e8019d3ed52a35efe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.244615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] RBAC: Authorizing `identity:get_group(group_id=b5929971d5d74a9e8019d3ed52a35efe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.246144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.247988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 220/450] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:30 2022] GET /identity/v3/groups/b5929971d5d74a9e8019d3ed52a35efe => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:30.254593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:30.308099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.309610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.371513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c81ff-0620-4e38-a537-52711615a5d1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.372432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:30.411752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.411941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.412204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.413334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.413334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] RBAC: Adding query filter params (group.id=b5929971d5d74a9e8019d3ed52a35efe, role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=fa9850d74b2443dda42cfa15e364b370) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:30.413660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.416115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.421868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 221/451] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:30 2022] GET /identity/v3/role_assignments?group.id=b5929971d5d74a9e8019d3ed52a35efe&scope.project.id=fa9850d74b2443dda42cfa15e364b370&role.id=0778d0e990d0435eaff002965dc033ca => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:30.434788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 231/452] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:30.441009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:30.508977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:30.551246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91140117-19ac-4190-9524-bb1548645d28 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.589068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.589963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.590243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.590519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] PATH_INFO: `/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.591707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] RBAC: Authorizing `identity:get_project(project_id=9a4af5872a8c47a1a7622f9d72a65eeb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.593151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.594885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 222/453] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:54:30 2022] GET /identity/v3/projects/9a4af5872a8c47a1a7622f9d72a65eeb => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:30.600421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:30.708613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad5511-d689-466d-9d7f-845a1c67bb11 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.745940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f788f2-9d65-43e2-9ad7-98df65d8c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.746797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f788f2-9d65-43e2-9ad7-98df65d8c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.747072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f788f2-9d65-43e2-9ad7-98df65d8c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.747341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f788f2-9d65-43e2-9ad7-98df65d8c2c3 None admin] PATH_INFO: `/v3/groups/a529415983e948ab8e628911fb7be5cc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.748512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f788f2-9d65-43e2-9ad7-98df65d8c2c3 None admin] RBAC: Authorizing `identity:get_group(group_id=a529415983e948ab8e628911fb7be5cc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.750001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f788f2-9d65-43e2-9ad7-98df65d8c2c3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.751775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 232/454] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 13:54:30 2022] GET /identity/v3/groups/a529415983e948ab8e628911fb7be5cc => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:30.757592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:30.860401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1155fe-524d-47d9-bdef-5bf2abb13efd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:30.888934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:30.894779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8698ed-df59-4846-a48e-6e93a51d7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:30.895427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8698ed-df59-4846-a48e-6e93a51d7046 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:30.895709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8698ed-df59-4846-a48e-6e93a51d7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:30.895984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8698ed-df59-4846-a48e-6e93a51d7046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:30.896821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8698ed-df59-4846-a48e-6e93a51d7046 None admin] RBAC: Adding query filter params (group.id=a529415983e948ab8e628911fb7be5cc, role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=9a4af5872a8c47a1a7622f9d72a65eeb) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:30.897134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8698ed-df59-4846-a48e-6e93a51d7046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:30.898601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8698ed-df59-4846-a48e-6e93a51d7046 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:30.904688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 223/455] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 13:54:30 2022] GET /identity/v3/role_assignments?group.id=a529415983e948ab8e628911fb7be5cc&scope.project.id=9a4af5872a8c47a1a7622f9d72a65eeb&role.id=12c8bb015e454a52a54bf61032d11091 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:33.262059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb72b1-87e1-4646-aea3-8280ca6ca562 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.263059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb72b1-87e1-4646-aea3-8280ca6ca562 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.263536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb72b1-87e1-4646-aea3-8280ca6ca562 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.265331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 233/456] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:33.270957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234999e1-d4b8-41b7-a8c0-fb5fc2ebd46a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.271355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234999e1-d4b8-41b7-a8c0-fb5fc2ebd46a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.271510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234999e1-d4b8-41b7-a8c0-fb5fc2ebd46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.294441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-234999e1-d4b8-41b7-a8c0-fb5fc2ebd46a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:33.295925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-234999e1-d4b8-41b7-a8c0-fb5fc2ebd46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:33.396045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 224/457] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:33.431855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb72b1-87e1-4646-aea3-8280ca6ca562 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:33.458946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:33.587147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb72b1-87e1-4646-aea3-8280ca6ca562 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:33.636320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:33.637539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.638023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.638491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.651198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:33.652579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:33.655175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b966-beba-4546-b091-5d278d4c7f16 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.655566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b966-beba-4546-b091-5d278d4c7f16 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.656073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b966-beba-4546-b091-5d278d4c7f16 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.657697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 225/458] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:33.670728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532baf-3fa9-4572-8f2f-6d6ac4f172af None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.671295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532baf-3fa9-4572-8f2f-6d6ac4f172af None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.671768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e532baf-3fa9-4572-8f2f-6d6ac4f172af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:33.674102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:33.674917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:33.676139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:33.676139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:33.676139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:33.676139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:33.676139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 234/459] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:33.681886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:33.700609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e532baf-3fa9-4572-8f2f-6d6ac4f172af None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:33.702204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e532baf-3fa9-4572-8f2f-6d6ac4f172af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:33.775341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:33.789454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 226/460] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:33.791692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf759-59ad-4e96-9153-bffb9a84e2e9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.792121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf759-59ad-4e96-9153-bffb9a84e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.792819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf759-59ad-4e96-9153-bffb9a84e2e9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.794795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 227/461] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:33.800819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587fdb-6ea2-4933-bc93-9075668574d6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.801105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587fdb-6ea2-4933-bc93-9075668574d6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.801406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587fdb-6ea2-4933-bc93-9075668574d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.822492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cb877-2ab9-4ad4-9f3c-72a0d34d8a92 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:33.828600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c587fdb-6ea2-4933-bc93-9075668574d6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:33.829825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c587fdb-6ea2-4933-bc93-9075668574d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:33.861042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:33.861740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:33.862023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:33.862299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:33.863020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:33.863329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:33.864715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:33.879926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 235/462] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:33.881112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:33.899906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:33.924120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 228/463] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:33.930001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c587fdb-6ea2-4933-bc93-9075668574d6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.030235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0770e-af48-42d4-bbf3-57d42cc75131 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:34.057480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c587fdb-6ea2-4933-bc93-9075668574d6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:34.065958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:34.077263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:34.078800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.079276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.079749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.098121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:34.100388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:34.106745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:34.107717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.108179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.108632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.109707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:34.111591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:34.122219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:34.123297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:34.124490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:34.124490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:34.124490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:34.124490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:34.124490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 236/464] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:34.126769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.139019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 229/465] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:33 2022] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:34.140505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.192936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:34.249888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca171e1-8723-4228-a1e7-f6b6eba2f6d6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:34.308228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759bf3-bd7b-4570-ae49-d53a219fabad None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:34.330108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:34.330926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.331212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.331488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.343638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:34.345112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:34.353587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:34.355112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.355637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.356052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.356913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:34.357397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:34.358893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:34.363363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:34.364372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:34.366585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:34.366585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:34.366585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:34.366585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:34.366585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 237/466] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:34.370691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.377123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 230/467] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:34.386398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.417454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:34.501387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5a3a4-b743-4f00-b1b2-483fd24ba6a9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:34.528737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:34.532240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b360873-ac3b-4ca4-800b-1b8ddccd5b94 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:34.548027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acb583-2358-4c75-8a90-d64f1784e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:34.549197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acb583-2358-4c75-8a90-d64f1784e787 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.549719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acb583-2358-4c75-8a90-d64f1784e787 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.550197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acb583-2358-4c75-8a90-d64f1784e787 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.551102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acb583-2358-4c75-8a90-d64f1784e787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:34.551591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acb583-2358-4c75-8a90-d64f1784e787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:34.552969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acb583-2358-4c75-8a90-d64f1784e787 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:34.567400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 238/468] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:34.568755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8e13-43e6-4e8e-be18-9d3c074344e0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.569044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8e13-43e6-4e8e-be18-9d3c074344e0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.569325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd8e13-43e6-4e8e-be18-9d3c074344e0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.570765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 239/469] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:34.575816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8e13-43e6-4e8e-be18-9d3c074344e0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.576718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea21400-288e-4947-9b50-5e964c1f3d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:34.577755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21400-288e-4947-9b50-5e964c1f3d51 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.578052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21400-288e-4947-9b50-5e964c1f3d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.578327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea21400-288e-4947-9b50-5e964c1f3d51 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.579171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea21400-288e-4947-9b50-5e964c1f3d51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:34.580759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea21400-288e-4947-9b50-5e964c1f3d51 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:34.612706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 231/470] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:34 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:34.614989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915f9c-da04-4e1e-9b30-6baa715f29e5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.615510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915f9c-da04-4e1e-9b30-6baa715f29e5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.615992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18915f9c-da04-4e1e-9b30-6baa715f29e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.654755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-18915f9c-da04-4e1e-9b30-6baa715f29e5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:34.657141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-18915f9c-da04-4e1e-9b30-6baa715f29e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:34.754334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:34.763119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd8e13-43e6-4e8e-be18-9d3c074344e0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:34.776851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 232/471] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:34.779176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95a0c4-76ab-4013-8a38-f68140d417a3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.779480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95a0c4-76ab-4013-8a38-f68140d417a3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.779760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95a0c4-76ab-4013-8a38-f68140d417a3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.785688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 233/472] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:34.793908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282925d7-43bd-45c0-82d6-a7a17b8769e5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.794411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282925d7-43bd-45c0-82d6-a7a17b8769e5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.794542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282925d7-43bd-45c0-82d6-a7a17b8769e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.816087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-282925d7-43bd-45c0-82d6-a7a17b8769e5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:34.816665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:34.817282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-282925d7-43bd-45c0-82d6-a7a17b8769e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:34.817411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:34.817634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:34.817917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:34.818638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:34.820091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:34.850387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 240/473] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:34 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:34.851778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.915796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 234/474] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:34.942450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282925d7-43bd-45c0-82d6-a7a17b8769e5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:34.964207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:35.017953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22930864-7fd8-4e5c-94c3-fa54b88f5947 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:35.064005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:35.065181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:35.065643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:35.066047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:35.073388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282925d7-43bd-45c0-82d6-a7a17b8769e5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:35.080610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:35.082266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:35.094632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:35.105807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:35.106959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:35.107955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:35.107955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:35.107955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:35.107955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:35.109828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 241/475] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:35.114283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:35.136716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:35.137828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:35.138180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:35.138773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:35.139540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:35.140945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:35.151413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 13:54:35.151413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 13:54:35.151413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [parameters: {'id': '6e60b7c2cba341d0b7d542d2c67c12bd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 13:54:35.151413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 18 13:54:35.171632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 13:54:35.174188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 13:54:35.175150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 13:54:35.175985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:54:35.176819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:54:35.179053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'id': '6e60b7c2cba341d0b7d542d2c67c12bd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:35.180191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 13:54:35.182362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:35.185298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 235/476] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 13:54:34 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:35.185298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:35.265799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582084b-6b2d-45b4-aa3a-ecf102c67554 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:35.288030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:35.314247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed343-a5c9-4100-968a-a5ae6d86b586 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:35.314834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:35.314957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:35.315272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:35.315602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:35.316339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:35.316643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:35.319204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:35.335741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 242/477] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:35.341552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:35.377695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:35.378579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:35.378857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:35.379139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:35.391184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:35.399561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:35.400445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:35.401212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 236/478] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:54:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:35.406695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:35.473706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:35.516337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b1e42-3205-4c6f-9d30-f212f0dda333 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:35.553389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81812-f6be-49f0-8422-e64a920b4c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:35.554003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81812-f6be-49f0-8422-e64a920b4c40 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:35.554289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81812-f6be-49f0-8422-e64a920b4c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:35.554569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81812-f6be-49f0-8422-e64a920b4c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:35.555346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81812-f6be-49f0-8422-e64a920b4c40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:35.556190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81812-f6be-49f0-8422-e64a920b4c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:35.557602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81812-f6be-49f0-8422-e64a920b4c40 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:35.566476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 237/479] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:35.583060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8447d-6d29-4f46-9525-c0a94b39a7c4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:35.625989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b170cd-35cc-491d-ad9e-64ed8dff654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:35.626687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b170cd-35cc-491d-ad9e-64ed8dff654a None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:35.626977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b170cd-35cc-491d-ad9e-64ed8dff654a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:35.627253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b170cd-35cc-491d-ad9e-64ed8dff654a None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:35.627983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b170cd-35cc-491d-ad9e-64ed8dff654a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:35.629503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b170cd-35cc-491d-ad9e-64ed8dff654a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:35.661474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 243/480] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:35 2022] POST /identity/v3/users => generated 249 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:36.751989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f249206-50f9-4994-88ce-49d9755dc26b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:36.753009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f249206-50f9-4994-88ce-49d9755dc26b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:36.753522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f249206-50f9-4994-88ce-49d9755dc26b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:36.755456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 238/481] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:36.760443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0517f30-d816-4985-a25f-d756919d62fa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:36.761245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0517f30-d816-4985-a25f-d756919d62fa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:36.761767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0517f30-d816-4985-a25f-d756919d62fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:36.784301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a0517f30-d816-4985-a25f-d756919d62fa None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:36.786060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a0517f30-d816-4985-a25f-d756919d62fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:36.861959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 244/482] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:36.898026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f249206-50f9-4994-88ce-49d9755dc26b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:36.902616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:37.031949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f249206-50f9-4994-88ce-49d9755dc26b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:37.081965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:37.083140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.083643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.084202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.105565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:37.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:37.114197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:37.115655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 239/483] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:37.121122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0517f30-d816-4985-a25f-d756919d62fa None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:37.174790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:37.235207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0517f30-d816-4985-a25f-d756919d62fa None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:37.284618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100297-f6b1-4e83-bfa1-26ad5c898204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:37.285214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100297-f6b1-4e83-bfa1-26ad5c898204 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.285526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100297-f6b1-4e83-bfa1-26ad5c898204 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.285801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100297-f6b1-4e83-bfa1-26ad5c898204 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.286654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100297-f6b1-4e83-bfa1-26ad5c898204 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:37.286965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100297-f6b1-4e83-bfa1-26ad5c898204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:37.288352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100297-f6b1-4e83-bfa1-26ad5c898204 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:37.304796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 245/484] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:37.310069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:37.408757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:37.426231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb083f20-fe9c-4bb2-8461-5575bd62dcde None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.426551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb083f20-fe9c-4bb2-8461-5575bd62dcde None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.426788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb083f20-fe9c-4bb2-8461-5575bd62dcde None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.428316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 246/485] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:37.438006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75bdd5-59c6-4fee-8832-c2c9117038cb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.438295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75bdd5-59c6-4fee-8832-c2c9117038cb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.438578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75bdd5-59c6-4fee-8832-c2c9117038cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.466752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df368f6-ba45-4eef-8d01-ae2cc3fe0773 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:37.477922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7a75bdd5-59c6-4fee-8832-c2c9117038cb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:37.479109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7a75bdd5-59c6-4fee-8832-c2c9117038cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:37.526184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09881b3b-d27c-4ce0-86d1-d3513994f549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:37.526989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881b3b-d27c-4ce0-86d1-d3513994f549 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.527265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881b3b-d27c-4ce0-86d1-d3513994f549 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.527531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09881b3b-d27c-4ce0-86d1-d3513994f549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.542174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09881b3b-d27c-4ce0-86d1-d3513994f549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:37.543570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09881b3b-d27c-4ce0-86d1-d3513994f549 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-09881b3b-d27c-4ce0-86d1-d3513994f549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:37.567352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:37.568253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:37.569076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:37.569076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:37.569076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:37.569076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:37.570445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 240/486] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:37.571276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6281a-2921-4b46-a428-9535f90aad43 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.571559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6281a-2921-4b46-a428-9535f90aad43 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.571788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d6281a-2921-4b46-a428-9535f90aad43 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.573105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 241/487] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:37.575554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6281a-2921-4b46-a428-9535f90aad43 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:37.587320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 247/488] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:37.588747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ef27-acca-4652-985f-43e29e5237c2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.589110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ef27-acca-4652-985f-43e29e5237c2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.589496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1ef27-acca-4652-985f-43e29e5237c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.619939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-20a1ef27-acca-4652-985f-43e29e5237c2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:37.621254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-20a1ef27-acca-4652-985f-43e29e5237c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:37.656528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:37.703167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 248/489] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:37.704170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ef27-acca-4652-985f-43e29e5237c2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:37.726663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d6281a-2921-4b46-a428-9535f90aad43 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:37.753738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:37.777729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:37.778771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.779252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.779723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.780683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:37.781910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:37.783736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:37.797458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 242/490] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:37.798609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:37.826551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1ef27-acca-4652-985f-43e29e5237c2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:37.864587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:37.865463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.865748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.866023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.877235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:37.885814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:37.886709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 249/491] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:37.887940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:37.908500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9339cc-adac-47af-8076-267ad92b725c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:37.919516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:37.945182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:37.946480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:37.946966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:37.947437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:37.958630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:37.967046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:37.967914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:37.968689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:37.976823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 243/492] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:37.979346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.002889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffd7b5-e3fa-4781-b364-af492845574b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.016327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.056736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.057477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.057764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.058118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.066338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.068121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:38.089367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:38.090338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 250/493] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:54:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:38.092876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.113474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54663510-cc01-4ed6-b496-96e24ddfb308 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.154034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.155389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.155884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.156380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.157465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:38.157847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.159247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.169130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 244/494] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:38.170019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.202766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.217331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d235d-a698-4250-8b59-143b615bbc1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.255027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69fa47-f8f6-41a6-ac4d-820c56091ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.255694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69fa47-f8f6-41a6-ac4d-820c56091ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.255980 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69fa47-f8f6-41a6-ac4d-820c56091ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.256360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69fa47-f8f6-41a6-ac4d-820c56091ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.257126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69fa47-f8f6-41a6-ac4d-820c56091ec2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:38.257569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69fa47-f8f6-41a6-ac4d-820c56091ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.259853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69fa47-f8f6-41a6-ac4d-820c56091ec2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.268517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 251/495] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:38.273624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4e053-82b0-46de-8d1d-fe8623ed3cad None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.273624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4e053-82b0-46de-8d1d-fe8623ed3cad None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.273624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4e053-82b0-46de-8d1d-fe8623ed3cad None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.273624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 252/496] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:38.273624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4e053-82b0-46de-8d1d-fe8623ed3cad None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.276675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.283912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d30e48-c7b2-4414-811d-8064ad36dbfd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.319236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.319829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.320113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.320391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.321628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:38.321988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.323485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.365745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 245/497] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:38.365745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.388384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4e053-82b0-46de-8d1d-fe8623ed3cad None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.424680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b96dd-6961-45e2-951d-253bcf3d1428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.425499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b96dd-6961-45e2-951d-253bcf3d1428 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.425783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b96dd-6961-45e2-951d-253bcf3d1428 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.426062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b96dd-6961-45e2-951d-253bcf3d1428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.437762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b96dd-6961-45e2-951d-253bcf3d1428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.439349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b96dd-6961-45e2-951d-253bcf3d1428 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-809b96dd-6961-45e2-951d-253bcf3d1428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:38.458593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:38.459513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:38.460329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:38.460329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:38.460329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:38.460329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:38.460329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 253/498] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:38.461218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5321a00-88e1-4c89-ac37-692a7b2180b4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.462209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5321a00-88e1-4c89-ac37-692a7b2180b4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.462370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5321a00-88e1-4c89-ac37-692a7b2180b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.467509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.478350 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804ed8b-5c45-4a36-ba0f-a803e9940a00 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.484765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e5321a00-88e1-4c89-ac37-692a7b2180b4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:38.486064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e5321a00-88e1-4c89-ac37-692a7b2180b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:38.515955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.516887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.517288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.517593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.528448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.530091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:38.549899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:38.550911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:38.551965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:38.551965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:38.551965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:38.551965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:38.555774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 246/499] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:38.556557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.558438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 254/500] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:38.559453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5321a00-88e1-4c89-ac37-692a7b2180b4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.566433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.662050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5321a00-88e1-4c89-ac37-692a7b2180b4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.662440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bca81-bb66-4f82-890a-a6f014fdc289 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.690892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.695192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.696438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.696590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ce14f-e6ed-4bfb-aa33-50a4fe74b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.696920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.697305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.697433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ce14f-e6ed-4bfb-aa33-50a4fe74b325 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.697702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ce14f-e6ed-4bfb-aa33-50a4fe74b325 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.697981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ce14f-e6ed-4bfb-aa33-50a4fe74b325 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.698699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ce14f-e6ed-4bfb-aa33-50a4fe74b325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:38.699005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ce14f-e6ed-4bfb-aa33-50a4fe74b325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.700398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ce14f-e6ed-4bfb-aa33-50a4fe74b325 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.716984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 255/501] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:38.716984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741506-acea-4d30-b3e7-4136dd934e28 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.716984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741506-acea-4d30-b3e7-4136dd934e28 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.716984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741506-acea-4d30-b3e7-4136dd934e28 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.716984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 256/502] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:38.716984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20741506-acea-4d30-b3e7-4136dd934e28 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.769684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.771135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.779827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.819439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20741506-acea-4d30-b3e7-4136dd934e28 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.854213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:38.854876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:38.855157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:38.855432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:38.856150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:38.856456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:38.857862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:38.869192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 257/503] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:38.870059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.879700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 247/504] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:38.879700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:38.924683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:38.974263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be49c0-705f-4138-bdc6-d123d52a8d22 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.979032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86b101-33f4-4d72-bdc5-49ca334f4c50 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:38.986212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.009248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.010140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.010356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.010632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.013283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291173be-020e-4d51-b541-97a89a96eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.014096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291173be-020e-4d51-b541-97a89a96eb72 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.014378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291173be-020e-4d51-b541-97a89a96eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.014656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291173be-020e-4d51-b541-97a89a96eb72 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.021645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291173be-020e-4d51-b541-97a89a96eb72 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.021896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.023104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291173be-020e-4d51-b541-97a89a96eb72 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.023336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-291173be-020e-4d51-b541-97a89a96eb72 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:39.040442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:39.041338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:39.042235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 248/505] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:39.043164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:39.044020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:39.045317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:39.045317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:39.045317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:39.045317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:39.045594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20edb6-5db6-479d-acec-46a8a3bc504c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.045594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20edb6-5db6-479d-acec-46a8a3bc504c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.045751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 258/506] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:39.045831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20edb6-5db6-479d-acec-46a8a3bc504c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.045909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.060732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fd20edb6-5db6-479d-acec-46a8a3bc504c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:39.062443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fd20edb6-5db6-479d-acec-46a8a3bc504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:39.134559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 249/507] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:39.135501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20edb6-5db6-479d-acec-46a8a3bc504c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.161907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83c6d2-9299-43c7-93b8-2493f32b0638 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.164204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.198577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.199291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.199578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.199855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.207484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.208923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:39.223434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:39.224538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 259/508] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:39.225488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.240192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.246093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20edb6-5db6-479d-acec-46a8a3bc504c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.282944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.283725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.284007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.284280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.295221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.296675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:39.313802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:39.314832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:39.315870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:39.315870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:39.315870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:39.315870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:39.315870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 250/509] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:39.315870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.330546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a13631-c558-4900-9b82-5331bcbbdee3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.364553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.365217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.365534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.365813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.366647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:39.366955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.368653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.407921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 260/510] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:39.408740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.415659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1338cb-bfd1-4f5d-b07d-7a34ee52c7c6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.434421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.453078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.454018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.454391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.454754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.455765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:39.456247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.457886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.469992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 251/511] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:39.470794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.481814 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.516856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a4a65-a0cb-4ae8-9a17-8bb48399fa45 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.552180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.552972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.553257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.553573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.564202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:39.571962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14d17-afcc-4339-944c-decbe475e831 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:39.572097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:39.572930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:39.573747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 261/512] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:39.574413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.611900 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.612573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.612858 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.613136 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.614017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:39.614327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.615764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.633517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 252/513] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:39.634331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.659480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.678825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8980b98-3d63-48dc-889a-a3293747006f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.700798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.716023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.716616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.716966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.717248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.718006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:39.718308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.719739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.732732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 262/514] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:39.733559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.741218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520c8a-2fdd-4e10-a852-02555957f9a1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.776046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.776695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.776971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.777248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.832676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a36bc6-44ea-47e0-8d0b-abcb933a534e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:39.846246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.847710 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.865710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:39.866377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:39.866662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:39.866940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:39.868204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:39.869835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:39.884563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.900113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 263/515] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:39 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:39.900113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:39.916527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:39.963192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 253/516] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:39.963192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.023207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6f9c3-8e11-42c0-b450-152b63da5b2f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.067007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.067677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.067956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.068252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.068999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:40.069300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.071264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.071534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc9902-408a-40a3-83b3-d0da8b380b1e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.081730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 264/517] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:40.081902 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.125071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.125772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.126054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.126326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.159477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.166392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.203951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6f9f-2f47-459d-8d27-bc5b7a484204 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.206015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.208272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.239787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.240589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.240879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.241161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.249489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.250935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:40.266394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:40.267440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:40.268305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 265/518] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:40.268766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.334614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 254/519] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:40.334614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.384548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55fa4-8646-44ea-9527-7d42ce2b065c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.403090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.405905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.422987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.423841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.424123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.424396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.436500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.437996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.440885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db604887-d2aa-4cb8-bc86-af8f2fdd8bb0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:40.456329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:40.457382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:40.458293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:40.458293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:40.458293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:40.458293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:40.458293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 266/520] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:40.458293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.485248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.486172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.486459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.486728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.498157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.499593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:40.519213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:40.520255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:40.521204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:40.521204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:40.521204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:40.521204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:40.521204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 255/521] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:40.522295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.569271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3cbfe-adb3-49d2-bac0-d3e29ab8233c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.606487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.606947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.607233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.607512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.608301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:40.608610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.610085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.628456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 267/522] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:40.629115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.640656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a8f67-c86b-4b52-bfde-178d436e1aec None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.659663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.663278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.679691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.681644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.681987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.682303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.693154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.695125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:40.713955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:40.714937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:40.715797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:40.715797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:40.715797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:40.715797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:40.715797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 256/523] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:40.716068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.742676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ce525-bc3e-4220-83ad-c7380d607a36 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.778716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.779481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.779777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.780043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.780832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:40.781142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.782544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.798341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 268/524] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:40.798341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.828780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a509db-f063-42f6-be3f-12b0599f3164 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.864348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.864935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.865222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.865552 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.866244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:40.866552 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.867971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.879656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 257/525] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:40.880312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:40.897223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.908926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde9c5a-d71e-4142-827e-58bc9fda6000 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:40.914343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:40.944866 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:40.945557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:40.946488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:40.946659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:40.947481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=85186f8437164bbbb99e007b5c85bd54) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:40.947794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:40.949258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:40.955204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 269/526] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/role_assignments?user.id=85186f8437164bbbb99e007b5c85bd54&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:40.955984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.020141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06336-dea7-47b1-a1ea-567838df7903 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.074980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.075975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.076266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.076546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.077860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:41.078199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.079617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.093253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a24d0-8d59-41ab-9793-da04f9a9dc24 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.098033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 258/527] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:41.098985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.137406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.138326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.138930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.139369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.147869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.150378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:41.165754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:41.167821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:41.170157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:41.173463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 270/528] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:41.173463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.192684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:41.221778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:41.233590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150d93-3e9a-473f-b53c-3dcc56ba07eb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.269784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.271010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.271485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.271972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.280646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.282488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.295075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c48e1-54a4-4c75-8e17-94d1b1b0255d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:41.299371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:41.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 13:54:41.301068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:41.303746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 259/529] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:41.304886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.337187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.338034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.338315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.338602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.347728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.349211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:41.369108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:41.370154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:41.371206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:41.372162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 271/530] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:41.373261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.420863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b41fc9-eff5-4704-ac8c-e7e2a7b10ba6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.459347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.460520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.462035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.462726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.463819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:41.464296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.466178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.479607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:41.498872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 260/531] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:41.498872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.511945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:41.515011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a41f73-16b6-4444-8fce-8988a79e8557 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.558651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.559753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.560289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.560994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.562065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:41.562640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.568699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.599701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 272/532] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:41.601056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.607824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724c7ff-5d3c-43b3-b2bd-8046bb876e2b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.644175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.644844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.645130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.645435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.646237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:41.646576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.648052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.663681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 261/533] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:41.664697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.720729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6a3e9-5c90-4895-9f75-195ee9dc1938 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.739067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:41.761576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.762600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.763140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.763709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.764773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=ae320f14f9e4422aa99f91fe730cdd2a) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:41.765320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.767204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.769398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:41.772830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56ad83-0cc6-4e03-8d24-55487ea9d3ef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:41.782210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 273/534] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/role_assignments?user.id=ae320f14f9e4422aa99f91fe730cdd2a&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:41.783605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:41.813622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:41.814283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:41.814838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:41.814838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:41.914292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:41.915999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:41.981102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b33a5-45d8-4417-98b4-bd57bb703290 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:42.044454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcd89c-8a4e-45e1-ab38-6fff7198b1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:42.045174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd89c-8a4e-45e1-ab38-6fff7198b1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:42.045598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:42.046554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd89c-8a4e-45e1-ab38-6fff7198b1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:42.046843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcd89c-8a4e-45e1-ab38-6fff7198b1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:42.048712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd89c-8a4e-45e1-ab38-6fff7198b1c0 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=fbcb9f234fd740fbb644d79ef7215f4d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:42.049037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd89c-8a4e-45e1-ab38-6fff7198b1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:42.051471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcd89c-8a4e-45e1-ab38-6fff7198b1c0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:42.058846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 274/535] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/role_assignments?user.id=fbcb9f234fd740fbb644d79ef7215f4d&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:42.061036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e591-f50f-41a1-b727-729b3c764ac2 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:42.061333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e591-f50f-41a1-b727-729b3c764ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:42.061646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e591-f50f-41a1-b727-729b3c764ac2 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:42.065648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 275/536] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:42.069121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0081787-6e8f-4a9e-ab99-4a4c6ac841c5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:42.069447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0081787-6e8f-4a9e-ab99-4a4c6ac841c5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:42.069728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0081787-6e8f-4a9e-ab99-4a4c6ac841c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:42.109961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f0081787-6e8f-4a9e-ab99-4a4c6ac841c5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:42.113313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f0081787-6e8f-4a9e-ab99-4a4c6ac841c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:42.131013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 262/537] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:42.137407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:42.265459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:42.282364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 276/538] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 13:54:42.334947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0081787-6e8f-4a9e-ab99-4a4c6ac841c5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:42.340883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989d57c-3e97-40fc-9972-b98619ca030b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:42.426313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:42.427129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:42.427413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:42.428383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:42.458247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:42.459732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:42.462700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0081787-6e8f-4a9e-ab99-4a4c6ac841c5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:42.491492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:42.493132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:42.494010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:42.494010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:42.494010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:42.494010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:42.501506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 263/539] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:42.504964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:42.506039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:42.507123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:42.507997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:42.509760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:42.536168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:42.547021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:42.547914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:42.548676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:42.558726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 277/540] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:42.565410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:42.566286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:42.684400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:42.693519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69650d54-93e2-47d4-afe3-12676b924e68 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:42.733141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:42.734306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:42.734794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:42.735275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:42.736196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:42.736703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:42.736821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c99e6-5153-4f68-8478-ab600af75bae None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:42.738632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:42.752477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 264/541] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:42.762455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:42.772123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:42.772790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:42.773075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:42.773374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:42.775497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:42.775806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:42.777236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:42.789995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 278/542] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:42.795557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:42.928389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:42.963651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948e00f-6e65-46d1-9c72-e88a75a56ebb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:42.989221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f426f-d986-4a3f-bef0-cbc10ae218bf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:43.013714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:43.031178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.031993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.032276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.032554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.046136 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:43.047539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:43.048561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.049419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.049702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.049977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.068240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:43.069731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:43.084615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:43.085531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:43.086580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 265/543] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:43.092397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:43.097366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:43.098163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:43.098973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:43.098973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:43.098973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:43.098973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:43.098973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 279/544] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:43.106294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:43.208013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4c49b-f927-44a8-8e5f-ee046c5afb71 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:43.244921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.245620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.245906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.246184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.246981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:43.247292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:43.248744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:43.261962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 266/545] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:43.267403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:43.276003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:43.276598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a58fd-47b0-4a15-94fa-82f7abdbfca7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:43.326758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.327643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.327925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.328196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.328922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:43.329225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:43.330627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:43.344398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 280/546] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:43.351571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:43.390255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:43.406349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107774a5-7527-45ad-b414-d431491d93a0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:43.441125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95d709-2cf1-4903-903b-9d2702732055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.441830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d709-2cf1-4903-903b-9d2702732055 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.442123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d709-2cf1-4903-903b-9d2702732055 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.442409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d709-2cf1-4903-903b-9d2702732055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.443257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95d709-2cf1-4903-903b-9d2702732055 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=2b28926500a14cd3aa74c59f60e076c8) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:43.443582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95d709-2cf1-4903-903b-9d2702732055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:43.445038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95d709-2cf1-4903-903b-9d2702732055 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:43.451322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 267/547] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/role_assignments?user.id=2b28926500a14cd3aa74c59f60e076c8&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:43.481387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04685a-53c3-41dc-b1a9-eca007adb8aa None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.481715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04685a-53c3-41dc-b1a9-eca007adb8aa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.481986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04685a-53c3-41dc-b1a9-eca007adb8aa None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.483766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 268/548] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:43.489519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57729-0813-4a20-a7de-cc5af888edd4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.489809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57729-0813-4a20-a7de-cc5af888edd4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.490096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a57729-0813-4a20-a7de-cc5af888edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.517782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b1a57729-0813-4a20-a7de-cc5af888edd4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:43.519048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1a57729-0813-4a20-a7de-cc5af888edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:43.575634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99053262-aa9c-44f3-96a7-5177ded98b44 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:43.594671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:43.606223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 269/549] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:43.630211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57729-0813-4a20-a7de-cc5af888edd4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:43.653854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.654661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.654947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.655226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.665079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:43.666098 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:43.682983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:43.684595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:43.685945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 281/550] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:43.691171 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:43.765897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a57729-0813-4a20-a7de-cc5af888edd4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:43.843601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.846539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.847269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.848905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.867815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:43.883855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:43.884805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:43.885632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:43.887591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:43.889202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 270/551] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:43.894692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:43.905369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350382b5-37e3-464b-907f-fcaeba91526f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:43.935472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:43.936269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:43.936467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:43.936696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:43.937575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:43.937886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:43.939331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:43.963038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 282/552] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:43.964363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.034382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.066281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e53d5-75a9-4b67-9b0c-c8b6a906fe5d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.105892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7551ac-2ada-4ad7-9f88-a93cf3778633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.106580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7551ac-2ada-4ad7-9f88-a93cf3778633 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.106922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7551ac-2ada-4ad7-9f88-a93cf3778633 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.107267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7551ac-2ada-4ad7-9f88-a93cf3778633 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.129791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.161372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f2be6-f6da-4f9d-a3bf-35fe1d233ae9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.177437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7551ac-2ada-4ad7-9f88-a93cf3778633 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:44.179038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7551ac-2ada-4ad7-9f88-a93cf3778633 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:44.224488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18c44-125b-4ab7-af49-bdbdc2a8e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.225492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18c44-125b-4ab7-af49-bdbdc2a8e114 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.225983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18c44-125b-4ab7-af49-bdbdc2a8e114 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.226457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18c44-125b-4ab7-af49-bdbdc2a8e114 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.227918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18c44-125b-4ab7-af49-bdbdc2a8e114 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:44.228570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18c44-125b-4ab7-af49-bdbdc2a8e114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:44.230169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18c44-125b-4ab7-af49-bdbdc2a8e114 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:44.239329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 271/553] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:44.240952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d22b-8c54-49c4-8a4e-b460f36128cd None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.241589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d22b-8c54-49c4-8a4e-b460f36128cd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.242073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d22b-8c54-49c4-8a4e-b460f36128cd None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.248310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 272/554] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:44.249369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d22b-8c54-49c4-8a4e-b460f36128cd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.285672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 283/555] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:44.287885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed013-2f4f-4092-bfd9-ff60e5ba2b93 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.289949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed013-2f4f-4092-bfd9-ff60e5ba2b93 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.290835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed013-2f4f-4092-bfd9-ff60e5ba2b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.307878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-64aed013-2f4f-4092-bfd9-ff60e5ba2b93 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:44.309333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-64aed013-2f4f-4092-bfd9-ff60e5ba2b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:44.353980 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.368722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d22b-8c54-49c4-8a4e-b460f36128cd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.384617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 284/556] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:44.386276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.391847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed013-2f4f-4092-bfd9-ff60e5ba2b93 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.412150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f45265-45a6-485c-a34d-60bcbf19204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.413704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45265-45a6-485c-a34d-60bcbf19204e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.414901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45265-45a6-485c-a34d-60bcbf19204e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.415514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45265-45a6-485c-a34d-60bcbf19204e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.427723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f45265-45a6-485c-a34d-60bcbf19204e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:44.429576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f45265-45a6-485c-a34d-60bcbf19204e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-72f45265-45a6-485c-a34d-60bcbf19204e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:44.448161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:44.449021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:44.450012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:44.450012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:44.450012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:44.450012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:44.450224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 273/557] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:44.451418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83ce4-f04c-4bbc-aeb4-e149ee1e3b75 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.451699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83ce4-f04c-4bbc-aeb4-e149ee1e3b75 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.451973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da83ce4-f04c-4bbc-aeb4-e149ee1e3b75 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.457461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 274/558] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:44.458208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da83ce4-f04c-4bbc-aeb4-e149ee1e3b75 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.505205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed013-2f4f-4092-bfd9-ff60e5ba2b93 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.542831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.543699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.544045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.544326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.555741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:44.557376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:44.565505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da83ce4-f04c-4bbc-aeb4-e149ee1e3b75 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:44.575078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:44.576404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:44.577611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:44.577611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:44.577611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:44.577611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:44.581276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 285/559] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:44.581983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.606884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11a250-d466-4071-9cf8-be13f3a41b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.607759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a250-d466-4071-9cf8-be13f3a41b07 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.608091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a250-d466-4071-9cf8-be13f3a41b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.608371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11a250-d466-4071-9cf8-be13f3a41b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.613070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.620986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11a250-d466-4071-9cf8-be13f3a41b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2c11a250-d466-4071-9cf8-be13f3a41b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:44.628733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:44.629649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:44.630484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 275/560] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:44.631240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fd1cf-ad06-435c-97af-824dd5cc38b6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.631942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fd1cf-ad06-435c-97af-824dd5cc38b6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.631942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fd1cf-ad06-435c-97af-824dd5cc38b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.648676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e55fd1cf-ad06-435c-97af-824dd5cc38b6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:44.650156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e55fd1cf-ad06-435c-97af-824dd5cc38b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:44.675122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.705741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414dc07-23cb-4b74-808d-bf7343f544ce None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.722377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 276/561] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:44.723538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fd1cf-ad06-435c-97af-824dd5cc38b6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.752478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.753234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.753546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.753829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.754554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:44.754858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:44.756243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:44.768985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 286/562] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:44.769896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.838602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fd1cf-ad06-435c-97af-824dd5cc38b6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.868251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.875524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.876129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.876413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.876686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.877440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:44.877770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:44.879118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:44.886526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac02d65-cde7-4c97-b2cb-2fab4d303855 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:44.898514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 277/563] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:44.900774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:44.927416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:44.927728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:44.928404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:44.928692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:44.929067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:44.930303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:44.930862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:44.932520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:44.949260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 287/564] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:44.949260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.017131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc56ccf-b90c-46da-b0fe-2a16214a0b07 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.052645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.053460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.053741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.054011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.066470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:45.075357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:45.076263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:45.077747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:45.082705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 278/565] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:45.082705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.098140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bf777-cf19-4c34-9c55-23d4543fe771 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.132657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.134001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.134285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.134660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.142504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.143951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:45.158268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:45.159257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 288/566] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:54:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:45.160754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.172420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.179361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.200576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d51ae1-5bcb-42f7-b76c-a5b3584ff58b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.238210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.239010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.239286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.239562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.246611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.248145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:45.263221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:45.264111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:45.265666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 279/567] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:45.269797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.281717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486123bc-a0a9-434c-9240-f11f2efba7a5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.319832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.321258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.323592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.323873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.335472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.337259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:45.355238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:45.356338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:45.357439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:45.357439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:45.357439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:45.357439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:45.362706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 289/568] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:45.363597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.379826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8c891-d25e-4918-bd4d-43e49101ef1d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.418588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.419180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.419459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.419733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.420477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:45.420779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.422173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.428877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.435287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 280/569] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:45.435287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.438236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.475515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8249e9-f333-459b-8d6d-1f4cd7495abd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.510192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.510863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.511294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.511851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.512774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:45.513087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.514546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.532781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 290/570] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:45.533628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.556685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62929-127b-49d3-839d-b387ad10f678 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.598640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.599572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.600004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.600448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.601412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:45.602361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.603796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.616847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 281/571] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:45.618040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.649527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d96595-13ad-4479-a3c0-09a367997294 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.668440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.683651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.689163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.689913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.690199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.690472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.691214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:45.691519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.692882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.706161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 291/572] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:45.706161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.731031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac48158-4f54-457f-9e20-74107c834a23 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.765976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.766765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.767042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.767312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.778245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.779675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:45.797633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:45.798667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:45.804261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:45.804261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:45.804261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:45.804261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:45.804261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 282/573] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:45.804261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.817439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f33c44-2765-46b6-8eff-98e342b9b6b6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.851922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.852711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.852994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.853271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.863634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.865075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:45.882351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:45.884112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:45.885144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:45.885144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:45.885144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:45.885144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:45.888845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 292/574] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:45.889642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.907048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e833fc-2824-4b62-8c73-2cbd9d5b8887 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:45.919817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.921315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:45.942548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32e6ec-a722-4c98-b732-c27ddd818e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:45.943127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e6ec-a722-4c98-b732-c27ddd818e07 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.943405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e6ec-a722-4c98-b732-c27ddd818e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.943675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32e6ec-a722-4c98-b732-c27ddd818e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.944500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e6ec-a722-4c98-b732-c27ddd818e07 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=38d55235b0374bfa8ea73ac3f4e2836b) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:45.944809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e6ec-a722-4c98-b732-c27ddd818e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:45.946416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32e6ec-a722-4c98-b732-c27ddd818e07 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:45.951809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 283/575] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/role_assignments?user.id=38d55235b0374bfa8ea73ac3f4e2836b&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:45.953248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29580b2e-cf9f-439a-8af2-d88ad7c73cbf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:45.953562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29580b2e-cf9f-439a-8af2-d88ad7c73cbf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:45.953834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29580b2e-cf9f-439a-8af2-d88ad7c73cbf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:45.959153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 284/576] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:45.959153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29580b2e-cf9f-439a-8af2-d88ad7c73cbf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:45.998575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd000ee-3ecd-4fa5-a15f-6c77dbdd36dd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.038569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.039816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.040125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.040419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.049058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.050578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:46.066053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:46.067058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:46.067985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 293/577] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:46.068584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.094264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29580b2e-cf9f-439a-8af2-d88ad7c73cbf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.133735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63775f75-d3ec-478f-838a-b5541da91720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.134386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63775f75-d3ec-478f-838a-b5541da91720 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.134668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63775f75-d3ec-478f-838a-b5541da91720 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.135004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63775f75-d3ec-478f-838a-b5541da91720 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.135726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63775f75-d3ec-478f-838a-b5541da91720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:46.136027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63775f75-d3ec-478f-838a-b5541da91720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.137423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63775f75-d3ec-478f-838a-b5541da91720 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.149411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 285/578] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:46.154978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3753-436a-41c5-bf06-b1892cbc2911 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.155333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3753-436a-41c5-bf06-b1892cbc2911 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.155680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be3753-436a-41c5-bf06-b1892cbc2911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.172885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-37be3753-436a-41c5-bf06-b1892cbc2911 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:46.174209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-37be3753-436a-41c5-bf06-b1892cbc2911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:46.178080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:46.188377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c80ca7-a1e1-4083-8989-fe6130b03507 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.208512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:46.224294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.225054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.225430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.225713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.226441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:46.227300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.228924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.241165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 294/579] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:46.242015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.256324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 286/580] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:46.257404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be3753-436a-41c5-bf06-b1892cbc2911 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.354747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5fc02-ebc6-4043-9042-8fc87534b1ee None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.371937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be3753-436a-41c5-bf06-b1892cbc2911 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.389965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.390706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.391059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.391414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.392317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:46.392694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.394217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.409549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.410665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.410945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.411219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.415382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 295/581] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:46.416161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.423562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.425023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.427791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:46.441011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:46.442280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:46.443242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 287/582] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:46.443816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.476654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:46.534561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cf2b9-29c3-46ed-9af5-273c4b51ed6d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.557802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427116-8a05-4595-b9cf-20e720fea601 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.569206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.570027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.570359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.570633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.577619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.579053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:46.593051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:46.594147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 296/583] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:46.595029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.596343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.597134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.597441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.597713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.612986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:46.622046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:46.622999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:46.623838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 288/584] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:46.624516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.671059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:46.706252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82798290-7361-4a30-965b-78087cacaad8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.722958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:46.738672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa55e58-5035-4cc8-a929-3409d40ea799 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.743285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.744195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.744573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.744941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.755512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.757052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.774085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.774751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:46.774947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:46.775927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:46.776986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:46.776986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:46.776986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:46.776986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:46.777247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.777247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.777247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:46.777247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.777949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.783024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 297/585] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:46.783024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.802209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 289/586] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:46.803137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.889793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dfd1d-7be6-46d4-864e-6fa279a75d59 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.907220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1e4b-e7cb-4dc8-ab1b-5738747919a3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:46.911268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:46.927500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.928160 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.928440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.928712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.929585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:46.930126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.931592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.949222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 298/587] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:46.949435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:46.949536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.949610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:46.949610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:46.949610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:46.949610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:46.949610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:46.949610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:46.958504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 290/588] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:46.963139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:46.972705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:47.060616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcd431-0875-44ab-900e-b7c2bf028a6d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.081511 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072692-43ea-408d-acd3-bb65b20cb39c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.099170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.099916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.100267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.100912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.101455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:47.101765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.103141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.119696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 299/589] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:47.119696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.127325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.128119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.128394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.128669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.140264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.141735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:47.158822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:47.159774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:47.160670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:47.160670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:47.160670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:47.160670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:47.160670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 291/590] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:47.160940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.167524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:47.225798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:47.231988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45553e13-10a4-4b44-8775-67a1ab6fc70c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.270278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.271166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.271451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.271731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/85186f8437164bbbb99e007b5c85bd54/roles/17da537249e74814b7c89c0c614f5da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.271830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5891a0-e273-4722-a447-d69c776e0787 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.287298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=85186f8437164bbbb99e007b5c85bd54, role_id=17da537249e74814b7c89c0c614f5da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.288737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.304003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 300/591] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:47 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/85186f8437164bbbb99e007b5c85bd54/roles/17da537249e74814b7c89c0c614f5da3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:47.313777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.318734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.319741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.320102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.321011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.334221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.336995 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:47.359857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:47.360861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:47.361782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:47.361782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:47.361782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:47.361782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:47.366952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 292/592] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:47.368085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.439524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:47.454277 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea7251-d6b3-419f-9ee0-2f722e463d32 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.502962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.503767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.504050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.504268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6e127-920f-4560-881e-8853fdd246bb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.504389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.513005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.515524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.520202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:47.534589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:47.535770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:47.536888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 301/593] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:47.537668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.547831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.548660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.549045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.549454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.550293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:47.550746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.552186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.565443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 293/594] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:47.566505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.665507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db930-cc5d-43d8-975f-8e9a16069ae3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.688438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0286f8-d1b9-4fa8-8c1d-f4dacfb8af33 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.713594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.714264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.714544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.714824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.715549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:47.715856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.717302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.731422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 302/595] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:47.732397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.732665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.733391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.733793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.734168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.735444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:47.735857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.738645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.746603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:47.758025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 294/596] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:47.759564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.802897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:47.867859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537dadd-5902-469b-9eaa-b550340aac42 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.889377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6625a-a653-47da-bdd3-1d1c99fb0ad3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:47.913541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.915545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.915930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.916498 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.925484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.926634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:47.926937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.927526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:47.927893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:47.928173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:47.937303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:47.938784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:47.944113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:47.946490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 303/597] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:47.948792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:47.955096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:47.956019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 295/598] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:47.957035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.038032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.064203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.074938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb89b2a-4cc3-47e4-b8db-215de3cb1e5c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.078608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f0d04-d1d1-4c48-a8e4-c4085b637f81 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.116708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95a7d-4795-4b46-a6f3-aca49e7c70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.118397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95a7d-4795-4b46-a6f3-aca49e7c70c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.118687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95a7d-4795-4b46-a6f3-aca49e7c70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.119027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95a7d-4795-4b46-a6f3-aca49e7c70c1 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/ae320f14f9e4422aa99f91fe730cdd2a/roles/17da537249e74814b7c89c0c614f5da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.120877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.121912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.122255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.123492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.124363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:48.124743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:48.126279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:48.136046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f95a7d-4795-4b46-a6f3-aca49e7c70c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=ae320f14f9e4422aa99f91fe730cdd2a, role_id=17da537249e74814b7c89c0c614f5da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:48.138114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f95a7d-4795-4b46-a6f3-aca49e7c70c1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:48.143313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 296/599] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:48.144264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.161937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 304/600] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:47 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/ae320f14f9e4422aa99f91fe730cdd2a/roles/17da537249e74814b7c89c0c614f5da3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:48.161937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e1ac8-f651-48fc-a60e-8b407c48e270 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.161937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e1ac8-f651-48fc-a60e-8b407c48e270 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.161937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e1ac8-f651-48fc-a60e-8b407c48e270 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.162388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 305/601] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:48.163092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e1ac8-f651-48fc-a60e-8b407c48e270 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.288617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e1ac8-f651-48fc-a60e-8b407c48e270 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.300645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7460a-cdb9-46ed-89c8-539649c6b937 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.312831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.333235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf969a-1e76-4970-8ccf-91cf327fb6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.334256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf969a-1e76-4970-8ccf-91cf327fb6ff None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.334538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf969a-1e76-4970-8ccf-91cf327fb6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.334898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf969a-1e76-4970-8ccf-91cf327fb6ff None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/fbcb9f234fd740fbb644d79ef7215f4d/roles/17da537249e74814b7c89c0c614f5da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.348887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.349707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.349976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.350256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.351094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:48.351884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf969a-1e76-4970-8ccf-91cf327fb6ff None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=fbcb9f234fd740fbb644d79ef7215f4d, role_id=17da537249e74814b7c89c0c614f5da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:48.352006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:48.353700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf969a-1e76-4970-8ccf-91cf327fb6ff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:48.353878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:48.368891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 306/602] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:48 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/fbcb9f234fd740fbb644d79ef7215f4d/roles/17da537249e74814b7c89c0c614f5da3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:48.370284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef01a23-eb9c-4b3d-b02c-adadd0695851 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.370631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef01a23-eb9c-4b3d-b02c-adadd0695851 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.370965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef01a23-eb9c-4b3d-b02c-adadd0695851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.386406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 297/603] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Jul 18 13:54:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:48.391353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6ef01a23-eb9c-4b3d-b02c-adadd0695851 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:48.392546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.392743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ef01a23-eb9c-4b3d-b02c-adadd0695851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:48.418968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.471543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 307/604] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:48.494675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef01a23-eb9c-4b3d-b02c-adadd0695851 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.530135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e10650-66bf-4eba-821e-ac95859934a2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.571500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.572735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.573189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.573713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.586815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:48.588768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:48.605272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.608775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef01a23-eb9c-4b3d-b02c-adadd0695851 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:48.612823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:48.614747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:48.615862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:48.615862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:48.615862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:48.615862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:48.617721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 298/605] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:48.624711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.651728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.652801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.653083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.653480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.665735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:48.674134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:48.675352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:48.676410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:48.678590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 308/606] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:48.685225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.721741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.747959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504f813-09d8-412d-ab5e-8ea0505714ba None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.789862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11156e-aef4-4d1a-a1a0-c916a87c4e91 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.821223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.822229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.822745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.823185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.824077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:48.824677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:48.825766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:48.826433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:48.826633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:48.827257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:48.827620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:48.828463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:48.828863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:48.830543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:48.840206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 309/607] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:48.841762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 299/608] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:48.847240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.847672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:48.890688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:48.962419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5375cf-efde-4831-8a0f-bdc933cbed49 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:48.989698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:49.009844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:49.010830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:49.011179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:49.011463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:49.016331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7a260-e4fe-4e92-87e8-473511816f18 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:49.020265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:49.029982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:49.051618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:49.052436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:49.052714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:49.052983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:49.053917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:49.055240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:49.056140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:49.061724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 300/609] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:49.062716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:49.064340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:49.065860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:49.084596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:49.090249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:49.098967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:49.098967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:49.098967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:49.098967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:49.098967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 310/610] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:49.098967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:49.174675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:49.219263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f57949-5ad3-4ffa-b5e9-6635d4506a79 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:49.269100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399256ac-3662-47e1-93da-4bc540587475 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:49.284514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:49.287058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:49.287338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:49.287602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:49.288326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:49.288624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:49.290828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:49.316515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 311/611] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:49.322314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:49.354044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:49.355084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:49.355577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:49.356051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:49.357046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:49.357592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:49.359241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:49.387870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 301/612] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:49.394013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:49.426065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f51dd4-873b-454d-a4bd-199c54292ee6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:49.461488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:49.462278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:49.462555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:49.462826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:49.464800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:49.470947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:49.472758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:49.487898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:49.488876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:49.489842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 312/613] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:49.502340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:49.505718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:49.565383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b61ad7-0b26-459e-9b68-a896dd2f938d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:49.633660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:49.634569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:49.635029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:49.635321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/2b28926500a14cd3aa74c59f60e076c8/roles/17da537249e74814b7c89c0c614f5da3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:49.652991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=2b28926500a14cd3aa74c59f60e076c8, role_id=17da537249e74814b7c89c0c614f5da3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:49.654487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:49.677561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 302/614] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:49 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/2b28926500a14cd3aa74c59f60e076c8/roles/17da537249e74814b7c89c0c614f5da3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:54:49.739868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0021b-fb98-4886-94d8-7108f9dbba4c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:49.870182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6787179-b417-4f0e-b3e1-0f45c7b0045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:49.870898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787179-b417-4f0e-b3e1-0f45c7b0045a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:49.871187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787179-b417-4f0e-b3e1-0f45c7b0045a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:49.871470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6787179-b417-4f0e-b3e1-0f45c7b0045a None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:49.872344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787179-b417-4f0e-b3e1-0f45c7b0045a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:49.872657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787179-b417-4f0e-b3e1-0f45c7b0045a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:49.874198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6787179-b417-4f0e-b3e1-0f45c7b0045a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:49.905988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 313/615] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 13:54:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:49.911471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:50.027246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0d9d-4772-4301-af82-cc8a1848ac9b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.027573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0d9d-4772-4301-af82-cc8a1848ac9b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.027844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0d9d-4772-4301-af82-cc8a1848ac9b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.029432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 314/616] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:54:50.037683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615ad3-dc3b-444b-b5aa-56d10bffe7c2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.037978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615ad3-dc3b-444b-b5aa-56d10bffe7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.038259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615ad3-dc3b-444b-b5aa-56d10bffe7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.077255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a8615ad3-dc3b-444b-b5aa-56d10bffe7c2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:50.079824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a8615ad3-dc3b-444b-b5aa-56d10bffe7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:50.081711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:50.100205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5b63e-fde4-422e-ba7d-af71f70fadb1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:50.173661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:50.174462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.174740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.175010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.189964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:50.200856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:50.203009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:50.237082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:50.238680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:50.240189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:50.240189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:50.240189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:50.240189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:50.240562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 315/617] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:50.240692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 303/618] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:50.251853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615ad3-dc3b-444b-b5aa-56d10bffe7c2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:50.290453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:50.501893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615ad3-dc3b-444b-b5aa-56d10bffe7c2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:50.535497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d58e8e-de79-42aa-bd0d-433b5f57d7dc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:50.575489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:50.576630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.577430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.578932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.593445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:50.594580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.595066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.595538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.596554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:50.598225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:50.599868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:50.609280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:50.624904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:50.626093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:50.626915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:50.630543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 316/619] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:50.632209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 304/620] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:50.638444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:50.639976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:50.651959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:50.721178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:50.801596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee12d-a95e-4bbb-9722-a4f73f537bc0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:50.812268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423f341-8bca-4290-842b-52bc56b63aa7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:50.840184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a0770-c5f7-4091-8b8d-9aeaa7f591d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:50.841100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a0770-c5f7-4091-8b8d-9aeaa7f591d0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.841615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a0770-c5f7-4091-8b8d-9aeaa7f591d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.842105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a0770-c5f7-4091-8b8d-9aeaa7f591d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.842922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a0770-c5f7-4091-8b8d-9aeaa7f591d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:50.843225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a0770-c5f7-4091-8b8d-9aeaa7f591d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:50.844580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a0770-c5f7-4091-8b8d-9aeaa7f591d0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:50.846792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2184ad-abb5-48e2-81b9-b843a174488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:50.847583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2184ad-abb5-48e2-81b9-b843a174488a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.847868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2184ad-abb5-48e2-81b9-b843a174488a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.848146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2184ad-abb5-48e2-81b9-b843a174488a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.854117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 317/621] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:50.855533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdef255-0a56-45bf-897f-07cc67add223 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.855818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdef255-0a56-45bf-897f-07cc67add223 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.856089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdef255-0a56-45bf-897f-07cc67add223 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.857530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 318/622] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:50.858422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77309d26-c6e8-42ba-ad1b-ca8180a3b7ee None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.858659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77309d26-c6e8-42ba-ad1b-ca8180a3b7ee None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.858925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77309d26-c6e8-42ba-ad1b-ca8180a3b7ee None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.864297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 319/623] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:50.864297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77309d26-c6e8-42ba-ad1b-ca8180a3b7ee None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:50.865697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2184ad-abb5-48e2-81b9-b843a174488a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:50.867817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2184ad-abb5-48e2-81b9-b843a174488a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0c2184ad-abb5-48e2-81b9-b843a174488a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:50.883193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:50.884102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:50.885003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 305/624] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:50.886385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c51c-7757-4f69-9b0b-8cd57ed81401 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.886499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c51c-7757-4f69-9b0b-8cd57ed81401 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.886703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767c51c-7757-4f69-9b0b-8cd57ed81401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.905453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d767c51c-7757-4f69-9b0b-8cd57ed81401 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:50.906647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d767c51c-7757-4f69-9b0b-8cd57ed81401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:50.970064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:50.978801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77309d26-c6e8-42ba-ad1b-ca8180a3b7ee None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:50.979816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 306/625] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:50.981066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efb0c3-626a-4d1b-8da3-0ccc61dd47f7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:50.981464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efb0c3-626a-4d1b-8da3-0ccc61dd47f7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:50.981912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efb0c3-626a-4d1b-8da3-0ccc61dd47f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:50.991489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:51.001416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-36efb0c3-626a-4d1b-8da3-0ccc61dd47f7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:51.003138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36efb0c3-626a-4d1b-8da3-0ccc61dd47f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:51.034092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.035085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.035523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.035916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.048695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:51.049021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:51.075858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:51.078093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:51.080011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:51.080011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:51.080011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:51.080011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:51.082691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 320/626] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:51.083508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.103075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 307/627] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:51.103075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efb0c3-626a-4d1b-8da3-0ccc61dd47f7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.202553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8014932-3c91-4225-81c1-191f4ea07619 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.232796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efb0c3-626a-4d1b-8da3-0ccc61dd47f7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.238871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.239614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.239965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.240311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.241178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:51.241590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:51.243159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:51.256662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 321/628] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:51.257585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.263586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:51.276535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.277740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.278038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.278311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.280523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:51.291716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:51.299749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:51.300849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:51.301868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:51.303510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 308/629] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:51.303768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.383790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4c1fa-8efe-4da4-bf50-d881f7fdae81 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.417771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0a967-a7bc-4ad5-a5e3-c200ae005066 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.421492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.422168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.422460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.422741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.423473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:51.423782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:51.425299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:51.438586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 322/630] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:51.439484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.458569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.459475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.459835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.460186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.472381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:51.480651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:51.481643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:51.482470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:51.486632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 309/631] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:51.487847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.538403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:51.545686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:51.573195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31b852-07c1-4490-9cad-1829202e1f63 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.610371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0f70b-b54c-4304-9bb9-2f5afcde83a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.620054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.621073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.621448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.621800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/38d55235b0374bfa8ea73ac3f4e2836b/roles/17da537249e74814b7c89c0c614f5da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.644698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=38d55235b0374bfa8ea73ac3f4e2836b, role_id=17da537249e74814b7c89c0c614f5da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:51.646129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:51.661273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.669464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 323/632] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:54:51 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/38d55235b0374bfa8ea73ac3f4e2836b/roles/17da537249e74814b7c89c0c614f5da3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:54:51.669694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.669694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.669694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.669909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.669980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:51.669980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:51.669980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:51.675619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 310/633] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:51.675809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.793258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fccea-bde3-4bfd-a68a-1b3469fb3dc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.801390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:51.814883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcef354-7e9c-4b9a-b6bd-0cc03b4a7bdd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:51.831525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.832266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.832552 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.832833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.833640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:51.833952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:51.835346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:51.850793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 311/634] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:51.852328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.865607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:51.870025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:51.870899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:51.871178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:51.871459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:51.883259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:51.884719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:51.907858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:51.909050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 324/635] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:51.910236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:51.978625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4deba-d249-4588-974e-e79923a90bc7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.016633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.017621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.017766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046be227-a6db-4b4a-bd08-5b5e465fd17b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.018108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.018485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.031041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.032640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:52.052122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:52.053459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:52.054590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:52.054590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:52.054590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:52.054590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:52.055951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 312/636] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:52.056783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.056937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.057684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.058343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.058463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.074633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.076223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.092981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:52.097053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:52.097963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:52.098833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:52.098833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:52.098833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:52.098833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:52.102162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 325/637] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:52.109371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.145281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.179542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634126f-3610-4ff2-aa2e-6f2f8bafb221 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.212129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c693a-3f4d-403a-90c9-5fe784ab92bf None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.215788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.216461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.216740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.217011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.217878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:52.218181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.219597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.238318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 313/638] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:52.238956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.253380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc7f6f-3d2f-4ad5-8b01-4960eb908f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.254046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc7f6f-3d2f-4ad5-8b01-4960eb908f04 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.254332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc7f6f-3d2f-4ad5-8b01-4960eb908f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.254608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc7f6f-3d2f-4ad5-8b01-4960eb908f04 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.255336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc7f6f-3d2f-4ad5-8b01-4960eb908f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:52.255639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc7f6f-3d2f-4ad5-8b01-4960eb908f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.257007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc7f6f-3d2f-4ad5-8b01-4960eb908f04 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.274268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 326/639] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:52.274268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc268dd-ecb2-4eb4-b247-ff0d66664bf3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.274268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc268dd-ecb2-4eb4-b247-ff0d66664bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.274268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc268dd-ecb2-4eb4-b247-ff0d66664bf3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.274268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 327/640] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:52.274268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc268dd-ecb2-4eb4-b247-ff0d66664bf3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.331576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.355040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad37e5e-7d0f-42a4-adac-b7cbee0b8163 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.376841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.384552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc268dd-ecb2-4eb4-b247-ff0d66664bf3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.392095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.392761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.393037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.393305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.394127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:52.394430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.395855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.411899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 314/641] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:52.412736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.419496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.420148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.420434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.420708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.490077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.491441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.517417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1ba1-0893-4061-9457-c458e7a8a3b6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.556078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd25faf-cf1c-4d3a-903e-9ed97eb6446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.556856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd25faf-cf1c-4d3a-903e-9ed97eb6446d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.557133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd25faf-cf1c-4d3a-903e-9ed97eb6446d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.557432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd25faf-cf1c-4d3a-903e-9ed97eb6446d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.565693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd25faf-cf1c-4d3a-903e-9ed97eb6446d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.567122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd25faf-cf1c-4d3a-903e-9ed97eb6446d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.568855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4bd25faf-cf1c-4d3a-903e-9ed97eb6446d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:52.583591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:52.584895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:52.586460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 315/642] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:52.587256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225768-2da1-45c9-9f3d-62dfa63eea77 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.587256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225768-2da1-45c9-9f3d-62dfa63eea77 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.587256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225768-2da1-45c9-9f3d-62dfa63eea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.599513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.604771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f2225768-2da1-45c9-9f3d-62dfa63eea77 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:52.610174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 328/643] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:52.610308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f2225768-2da1-45c9-9f3d-62dfa63eea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:52.610404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.679663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 316/644] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:52.686798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225768-2da1-45c9-9f3d-62dfa63eea77 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.717600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b4ea-96f7-4f30-9342-4347dd6d323e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.752934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.753685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.753971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.754252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.761567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.763080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:52.779232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:52.780188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 329/645] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:52.786152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.801188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225768-2da1-45c9-9f3d-62dfa63eea77 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.830697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.839632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.840308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.840861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.840861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.841721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:52.842031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.843449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.846861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:52.862736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 317/646] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:52.863527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:52.900684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30037f57-b253-49e5-b739-3c5a5295c074 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.938832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:52.939780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:52.940066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:52.940345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:52.952063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:52.953574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:52.971044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc4b33-fc06-4d38-ad4f-a40013cd8881 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:52.971224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:52.972222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:52.973104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:52.973104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:52.973104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:52.973104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:52.973104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 330/647] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:52.973396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.015544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.016774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.017053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.017326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.028254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:53.036196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:53.037135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:53.038595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:53.042633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 318/648] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:53.043463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.097646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.106551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b8c58-83c1-4a3e-9b5f-608635f87772 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.117453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.142549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.143220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.143690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.143798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.144589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:53.144894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.146346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.162947 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761f554-3383-4787-8c67-a89c1ab37ab2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.165159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 331/649] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 13:54:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:53.166376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.206041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.206705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.206986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.207261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.275758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9227e-adbd-4571-a695-a13ad2b14142 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.282101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.283661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.311440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.312114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.312401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.312685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.313434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:53.313747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.315114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.327365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 332/650] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:53.328181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.340750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.368937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.406675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 319/651] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:53.407643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.462059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c3bd5b-1f21-4bcc-8988-acc7bfb5acf1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.499294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.500091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.500376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.500649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.501424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:53.501733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.503344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.511682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e3b49-9771-4068-8195-1c27b53adb62 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.516943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 333/652] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:53.516943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.551288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.551863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.552146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.552424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.568607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.611948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.624080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96edd-e66b-40a7-a168-eaaefcd2c75b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.637065 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.638540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.661356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.662170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.662455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.662737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.673474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.675010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:53.690285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:53.691168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:53.692396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 334/653] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:53.693797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.761326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 320/654] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:53.762572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.816408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.825444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a203916-ea87-4119-8ecf-0a106d24bd28 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.860602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.861414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.861696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.861974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.873634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7855-ef19-49a7-9233-daf6416eb068 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:53.874221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.875832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:53.893931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:53.894918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:53.895795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:53.895795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:53.895795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:53.895795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:53.895795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 335/655] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:53.896077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:53.900880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:53.911155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:53.911946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:53.912229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:53.912508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:53.922696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:53.924156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:53.942686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:53.943679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:53.944544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:53.944544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:53.944544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:53.944544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:53.944544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 321/656] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:53.945719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.003134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e79ca-6365-43d7-aae2-6f685d62a147 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.036268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c3436-e62a-448a-bf8e-ae53b50938bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.036933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c3436-e62a-448a-bf8e-ae53b50938bc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.037211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c3436-e62a-448a-bf8e-ae53b50938bc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.037510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c3436-e62a-448a-bf8e-ae53b50938bc None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.038295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c3436-e62a-448a-bf8e-ae53b50938bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:54.038743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c3436-e62a-448a-bf8e-ae53b50938bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.040174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c3436-e62a-448a-bf8e-ae53b50938bc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.040399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.044988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146172fb-395c-499b-ad75-4e5e33e6dd24 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.052240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 336/657] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:54.053625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07371c-d5dd-48e7-aebc-df9616a33742 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.053910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07371c-d5dd-48e7-aebc-df9616a33742 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.054819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07371c-d5dd-48e7-aebc-df9616a33742 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.056514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 337/658] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:54.057225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07371c-d5dd-48e7-aebc-df9616a33742 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.089672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.090471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.090752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.091034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.101201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.102732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:54.121060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:54.122009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:54.122869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:54.122869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:54.122869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:54.122869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:54.122869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 322/659] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:54.123462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.128535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.167828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07371c-d5dd-48e7-aebc-df9616a33742 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.203230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.203885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.204164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.204510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.205228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:54.205557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.206914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.217816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 338/660] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:54.218590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.227587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9086f-4261-4740-a84e-fd7ec39bfe4c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.262695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d314bee-058d-44d6-bb4b-47317278e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.263469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314bee-058d-44d6-bb4b-47317278e6fa None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.263825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314bee-058d-44d6-bb4b-47317278e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.264171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d314bee-058d-44d6-bb4b-47317278e6fa None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.264969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d314bee-058d-44d6-bb4b-47317278e6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:54.265370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d314bee-058d-44d6-bb4b-47317278e6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.266744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d314bee-058d-44d6-bb4b-47317278e6fa None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.278527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 323/661] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:54.279716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da035-06bb-4be9-a659-581eb9ab728b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.280008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da035-06bb-4be9-a659-581eb9ab728b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.280286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da035-06bb-4be9-a659-581eb9ab728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.296266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-684da035-06bb-4be9-a659-581eb9ab728b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:54.297512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-684da035-06bb-4be9-a659-581eb9ab728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:54.300213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.318907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6caaee-1739-4fa3-98e7-19b1fd0593bd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.341933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.353950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.354598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.354880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.355146 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.355968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=85186f8437164bbbb99e007b5c85bd54) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:54.356273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.357729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.363613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 339/662] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/role_assignments?user.id=85186f8437164bbbb99e007b5c85bd54&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:54.364227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.381378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 324/663] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:54.381378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da035-06bb-4be9-a659-581eb9ab728b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.489378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da035-06bb-4be9-a659-581eb9ab728b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.498664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb694df-a6af-4f67-b4c3-4f21f4307dfd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.529140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.529971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.530256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.530535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.539366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.540031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.540314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.540591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.541322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:54.541658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.543049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.545207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.547158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.550651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.559144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 340/664] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:54.564833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:54.564969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:54.565824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:54.566680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 325/665] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:54.567149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.615294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.675924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87286a-ee48-49f4-acad-e855ce0c9d8b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.686967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ad6b0-7bcf-4285-8f2d-7f18b14ca435 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.714811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.715604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.715886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.716154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.723915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.724787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.725355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.725748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.726736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.727021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.738268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:54.741306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:54.747419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 341/666] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:54.748392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:54.749061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:54.750535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:54.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 326/667] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:54.753448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.817442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.859482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46093c-06f9-4738-8c88-83b78ad60aa9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.862436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d306ee-f9ce-487d-874e-e8b8e00eaf90 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:54.868154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:54.899464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.900127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.900405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.900680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.901492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:54.901798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.902363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:54.903243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:54.903354 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.903692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:54.904059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:54.911240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:54.912969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:54.920750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 327/668] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:54.920750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:54.930219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:54.931276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:54.932359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:54.938306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 342/669] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:54.938306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.035328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75bf71-24ff-4ce5-9a43-2a2a337ccdb3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.042106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63361e-92d5-4ada-86ca-045e7a1323ea None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.057131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:55.075669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.076583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.077119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.077427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.078268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:55.078628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.080056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.081430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.082217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.082595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.082976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.083836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:55.084151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.086133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.100167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 343/670] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:55.100167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.103824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 328/671] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Jul 18 13:54:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:55.108229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.130240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:55.208419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc03ff-412c-442b-9ef7-62a5089be1ea None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.209818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adb84b-1e73-4064-ba65-db4329e5eac7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.244752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.245435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.245719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.246073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.246853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:55.247015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.247216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.247630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.247917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.248194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.248562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.249016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=fbcb9f234fd740fbb644d79ef7215f4d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:55.249327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.251469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.265328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 344/672] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/role_assignments?user.id=fbcb9f234fd740fbb644d79ef7215f4d&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:55.265328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.265603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 329/673] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:55.265603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.309412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:55.386492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102fe45-dfee-4966-be29-d3dcae215021 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.393872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:55.399017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040004f-adfa-4a32-b4ad-ed9055fff3ff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.426599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.427635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.428120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.428575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.440267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.441071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.441867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.441867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.458411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.461007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:55.479524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:55.480543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:55.481453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:55.481453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:55.481453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:55.481453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:55.481453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 345/674] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:55.481723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.513691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.515600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.568166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:55.623193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77f36-0e3a-48c9-86a8-192b65cca5ef None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.634133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 330/675] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:55.635103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.669118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.670612 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.670901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.671180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.672018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=ae320f14f9e4422aa99f91fe730cdd2a) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:55.672324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.673790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.685440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 346/676] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/role_assignments?user.id=ae320f14f9e4422aa99f91fe730cdd2a&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:55.686321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.712847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:55.789601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99e8bf-7655-4d13-91a2-58166de06fb6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.818143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945b59-95d9-4d32-8e27-26557c42fe6a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:55.860224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.860553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:55.861035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.861237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:55.861332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.861514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:55.861607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.861784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:55.862517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:55.862823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.864757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.873322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:55.874909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:55.876887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:55.885729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 331/677] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:55.892044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:55.904899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:55.905891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:55.906766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:55.906766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:55.906766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:55.906766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:55.907427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 347/678] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:55.914584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:56.002964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:56.041144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50313606-7503-4331-b0ad-7bee449fa999 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:56.059913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00493219-e2a2-4037-9520-a803523789a5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:56.101621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:56.102524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.102807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.103082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.109153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:56.109859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.110149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.110433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.111466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:56.111787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:56.112069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:56.113269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:56.113595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:56.127438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 348/679] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:56.133185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:56.134134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:54:56.135545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:56.136633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:56.136771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 332/680] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:56.142426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:56.253717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44324d-25be-4107-bb04-dff14fc7a5d2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:56.259622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:56.277729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:56.292571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:56.293408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.293702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.293990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.301574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:56.303037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:56.320145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:56.321262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:56.322258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 349/681] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:56.327572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:56.380471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07472f-ed94-4096-b19d-00f8e68dee56 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:56.434703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad10a1-43f9-4d69-9ce1-53ced0cd2b52 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:56.446472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:56.447857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.448434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.449041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.450111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:56.450647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:56.452739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:56.480270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:56.480996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.481283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.481586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.482384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:56.482748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:56.484196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:56.491855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 333/682] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 13:54:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:56.497056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:56.512493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 350/683] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:56.519829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:56.611698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:56.640330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ef68-9a2e-43fb-b3da-934c29888c14 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:56.664656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:56.694946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:56.696263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.696754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.697513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.717320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa9939-bbc5-4d28-bb04-89e939140499 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:56.774055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91eca0-fa69-4aa5-8ce2-1d5e2b811c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:56.774726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91eca0-fa69-4aa5-8ce2-1d5e2b811c06 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.775010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91eca0-fa69-4aa5-8ce2-1d5e2b811c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.775289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91eca0-fa69-4aa5-8ce2-1d5e2b811c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.776405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91eca0-fa69-4aa5-8ce2-1d5e2b811c06 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=2b28926500a14cd3aa74c59f60e076c8) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:56.776719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91eca0-fa69-4aa5-8ce2-1d5e2b811c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:56.778958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91eca0-fa69-4aa5-8ce2-1d5e2b811c06 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:56.797390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 351/684] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:56 2022] GET /identity/v3/role_assignments?user.id=2b28926500a14cd3aa74c59f60e076c8&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:56.797390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd70be-34e8-4c8b-a078-edbe9c676739 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.797390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd70be-34e8-4c8b-a078-edbe9c676739 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.797390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd70be-34e8-4c8b-a078-edbe9c676739 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.797390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 352/685] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:56.797866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:56.798909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:56.804828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26b3d-608b-4084-a03c-465552354300 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:56.805186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26b3d-608b-4084-a03c-465552354300 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:56.805450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f26b3d-608b-4084-a03c-465552354300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:56.842890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c4f26b3d-608b-4084-a03c-465552354300 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:56.844157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c4f26b3d-608b-4084-a03c-465552354300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:56.964738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 353/686] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:56.987616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f26b3d-608b-4084-a03c-465552354300 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.004100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 334/687] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 13:54:57.011741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.034830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:57.041838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:57.141673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f26b3d-608b-4084-a03c-465552354300 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:57.142543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e28d57-c5dd-4f87-9dfc-35838fba4bd7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:57.196367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:57.197173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.198548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a8703-8187-4d49-a531-273679d59869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:57.199345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a8703-8187-4d49-a531-273679d59869 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.199627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a8703-8187-4d49-a531-273679d59869 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.199908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a8703-8187-4d49-a531-273679d59869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.200537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.200823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.223816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:57.225300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:57.226812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a8703-8187-4d49-a531-273679d59869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-444a8703-8187-4d49-a531-273679d59869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:54:57.234884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:57.235813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:54:57.236649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:57.250142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 354/688] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:54:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:57.259759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a8703-8187-4d49-a531-273679d59869 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:57.273133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:57.275662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:57.277931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:57.277931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:57.277931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:57.277931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:57.277931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 335/689] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:57.281380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.393535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:57.393727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a8703-8187-4d49-a531-273679d59869 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:57.439362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:57.440476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.440962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.441471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.442421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:57.442927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:57.447091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:57.458008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 355/690] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:54:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:57.464597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:57.466056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.504730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e14a2e-4759-4671-81c4-87e2db8eba5f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:57.556929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554c589-60a8-4ab5-a019-7893cc597856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:57.558578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c589-60a8-4ab5-a019-7893cc597856 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.559184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c589-60a8-4ab5-a019-7893cc597856 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.560767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554c589-60a8-4ab5-a019-7893cc597856 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.562248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554c589-60a8-4ab5-a019-7893cc597856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:57.562922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554c589-60a8-4ab5-a019-7893cc597856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:57.565057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554c589-60a8-4ab5-a019-7893cc597856 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:57.588474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 336/691] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:57.592090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17534-7671-4538-ad66-f5f827484ee8 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.592385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17534-7671-4538-ad66-f5f827484ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.592664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c17534-7671-4538-ad66-f5f827484ee8 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.594235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 337/692] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:57.594947 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17534-7671-4538-ad66-f5f827484ee8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.662999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba28fc2-39f6-415c-82d2-5732ca458857 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:57.707091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd4f1c-33c7-42e4-a16a-d8f1357aefc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:57.708534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4f1c-33c7-42e4-a16a-d8f1357aefc2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.708822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4f1c-33c7-42e4-a16a-d8f1357aefc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.709101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4f1c-33c7-42e4-a16a-d8f1357aefc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.715435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c17534-7671-4538-ad66-f5f827484ee8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:57.723049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd4f1c-33c7-42e4-a16a-d8f1357aefc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:57.725005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd4f1c-33c7-42e4-a16a-d8f1357aefc2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:57.747825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-23fd4f1c-33c7-42e4-a16a-d8f1357aefc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:57.752474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:57.753585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:57.754562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:57.754562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:57.754562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:57.754562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:57.756549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 356/693] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:57.758983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489302e-1460-435d-b5e6-74c52c462735 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.759414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489302e-1460-435d-b5e6-74c52c462735 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.759820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489302e-1460-435d-b5e6-74c52c462735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.763885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:57.764819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.765234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.765705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.774095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:57.775695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:57.780028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0489302e-1460-435d-b5e6-74c52c462735 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:57.781452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0489302e-1460-435d-b5e6-74c52c462735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:57.784123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:54:57.795252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:57.796362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:54:57.797470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:57.799095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 338/694] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:57.800232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.880903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 357/695] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:57.882717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489302e-1460-435d-b5e6-74c52c462735 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:57.947917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58406896-2c63-4081-97e8-aa25327d91b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:57.987175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:57.988215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:57.988603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:57.989043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:57.990126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:57.990606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:57.993863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.007886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 339/696] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:58.008685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489302e-1460-435d-b5e6-74c52c462735 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.013446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.045469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.046352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.046791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.047227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.048141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:58.048594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.050184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.057494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:58.063211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 358/697] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:54:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:58.064110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.080179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:58.146111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cbf6d-6fbd-4902-addb-c4c08f92b336 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.176121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d5f0c-990f-4658-8a97-f218cf030097 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.186713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.187788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.188307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.188732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.201840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.203700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.213800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.214731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.215114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.215490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.223555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:58.224101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:58.225156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:58.226755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:58.226755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:58.226755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:58.226755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:58.227943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.228827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 340/698] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:58.229880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:54:58.249156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:58.250227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 359/699] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:58.252406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.316109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:58.346695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:58.350129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2a7fe-a7cd-411b-8762-842937108129 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.364663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0e69b-06b8-46ac-a960-953c10f30103 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.394533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea76ab2-359b-4cc3-857c-346c472f10a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.395194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea76ab2-359b-4cc3-857c-346c472f10a9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.395517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea76ab2-359b-4cc3-857c-346c472f10a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.395748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea76ab2-359b-4cc3-857c-346c472f10a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.396573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea76ab2-359b-4cc3-857c-346c472f10a9 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=38d55235b0374bfa8ea73ac3f4e2836b) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:58.396884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea76ab2-359b-4cc3-857c-346c472f10a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.399320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea76ab2-359b-4cc3-857c-346c472f10a9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.401931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68a4c2-9e87-4832-a6cf-a7dc65cb702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.402593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68a4c2-9e87-4832-a6cf-a7dc65cb702c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.402882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68a4c2-9e87-4832-a6cf-a7dc65cb702c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.403162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68a4c2-9e87-4832-a6cf-a7dc65cb702c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.403883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68a4c2-9e87-4832-a6cf-a7dc65cb702c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:58.404191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68a4c2-9e87-4832-a6cf-a7dc65cb702c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.412670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68a4c2-9e87-4832-a6cf-a7dc65cb702c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.412845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 341/700] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/role_assignments?user.id=38d55235b0374bfa8ea73ac3f4e2836b&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:58.412845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a181f-e1ca-4bfa-a2d0-9ff810d7f5c7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.412845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a181f-e1ca-4bfa-a2d0-9ff810d7f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.412845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a181f-e1ca-4bfa-a2d0-9ff810d7f5c7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.412845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 342/701] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:58.412845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a181f-e1ca-4bfa-a2d0-9ff810d7f5c7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.430191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 360/702] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:58.431600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93ab2-50d5-46b4-887d-19e99a059a59 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.432926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93ab2-50d5-46b4-887d-19e99a059a59 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.432926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd93ab2-50d5-46b4-887d-19e99a059a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.451352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4fd93ab2-50d5-46b4-887d-19e99a059a59 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:58.453014 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4fd93ab2-50d5-46b4-887d-19e99a059a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:58.538842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 361/703] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:58.540148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd93ab2-50d5-46b4-887d-19e99a059a59 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.573745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a181f-e1ca-4bfa-a2d0-9ff810d7f5c7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.617235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:58.622736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.623427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.623760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.624030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.624873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:58.625230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.626950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.647491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 343/704] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:58.648728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.675027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:58.697312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd93ab2-50d5-46b4-887d-19e99a059a59 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.743668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.744279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.744542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.744818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.745643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.747178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.774345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 362/705] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:54:58 2022] POST /identity/v3/users => generated 254 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:54:58.775212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.775864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c6ed0-64d0-4bc5-a07c-a7787bf05b0f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.860290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:58.861118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:58.861664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:58.861957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:58.864090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:58.865554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:58.896091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:58.897304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:58.898368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 344/706] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:58.905134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:58.990625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198df38-6303-4cd5-97d1-c456288a1b31 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:58.994544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:59.032135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20142094-09b9-4039-8f50-734b3efdac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:59.032903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142094-09b9-4039-8f50-734b3efdac6c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.033187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142094-09b9-4039-8f50-734b3efdac6c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.033492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20142094-09b9-4039-8f50-734b3efdac6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.036377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:59.055606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8692d2-f0f6-411f-84c2-a4305d42169a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:59.099403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:59.100411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.101533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.102074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.103058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:59.103576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:59.105329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:59.110934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 345/707] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:54:59.115918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:59.126428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142094-09b9-4039-8f50-734b3efdac6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:59.128348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20142094-09b9-4039-8f50-734b3efdac6c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:59.258800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 363/708] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:54:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:54:59.260217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94788c-e66e-4ee9-bf5f-d72c89a74c9a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.260506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94788c-e66e-4ee9-bf5f-d72c89a74c9a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.260787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94788c-e66e-4ee9-bf5f-d72c89a74c9a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.262442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 364/709] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:54:59.266205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94788c-e66e-4ee9-bf5f-d72c89a74c9a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:59.271770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:59.272680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d4b4-0cb0-4ede-9c48-9e25444b1b1f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:59.312416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936c9f9-27ef-46de-ae8f-04b3f57537f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:59.313088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c9f9-27ef-46de-ae8f-04b3f57537f7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.313387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c9f9-27ef-46de-ae8f-04b3f57537f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.313716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c9f9-27ef-46de-ae8f-04b3f57537f7 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.314430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936c9f9-27ef-46de-ae8f-04b3f57537f7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:59.314734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936c9f9-27ef-46de-ae8f-04b3f57537f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:59.316113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936c9f9-27ef-46de-ae8f-04b3f57537f7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:59.322683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 346/710] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 13:54:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:59.324063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5029c9-0033-4e42-9565-2acdbdc3be1f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.324352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5029c9-0033-4e42-9565-2acdbdc3be1f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.324632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5029c9-0033-4e42-9565-2acdbdc3be1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.343442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bf5029c9-0033-4e42-9565-2acdbdc3be1f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:54:59.344717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bf5029c9-0033-4e42-9565-2acdbdc3be1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:54:59.356767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:59.418009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94788c-e66e-4ee9-bf5f-d72c89a74c9a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:59.440011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 347/711] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:54:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:54:59.463487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5029c9-0033-4e42-9565-2acdbdc3be1f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:59.508962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:59.509718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.509995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.513939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.529313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:59.530924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:54:59.552360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:59.553269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:59.555006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:54:59.555006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:54:59.555006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:54:59.555006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:54:59.555006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 365/712] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:54:59.560101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:59.604610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5029c9-0033-4e42-9565-2acdbdc3be1f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:59.635831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:59.648580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:59.649435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.649724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.649996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] PATH_INFO: `/v3/services/network` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.650659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:59.652034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:54:59.665055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:54:59.666163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:54:59.667035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 348/713] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:59 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:54:59.674460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:59.692853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:54:59.705636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c507-a31b-4175-8920-9cf1444cdcbc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:59.766988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:59.768660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.769183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.769897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.770887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:59.771448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:59.773745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:59.788493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 366/714] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:59.795191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:59.873385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5075ce13-5734-4549-b224-5c5b03f31e12 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:54:59.915909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:54:59.916934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:54:59.917470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:54:59.917973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:54:59.919171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:54:59.920130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:54:59.921899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:54:59.927606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 349/715] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:54:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:54:59.933179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:54:59.993662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7e479-fdc8-437c-b9d6-513e06be9fd3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:00.017811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:00.032478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:00.033620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:00.034229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:00.034825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:00.043102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:00.044904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:00.061022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:00.061966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:00.062865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:00.065103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 367/716] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:54:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:00.071000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:00.072335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:00.105143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f32a-19c5-4cc8-a555-8732c0ef1ffe None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:00.159324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:00.160045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:00.160326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:00.160707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:00.161359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:00.161672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:00.163168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:00.168096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 350/717] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:54:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:00.259804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f2f38-efbb-47a2-b094-744c5f0a52fa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:00.298765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870aed7-6ed9-43a8-aea3-51f0ff4458c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:00.299438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870aed7-6ed9-43a8-aea3-51f0ff4458c0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:00.299720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870aed7-6ed9-43a8-aea3-51f0ff4458c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:00.299997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870aed7-6ed9-43a8-aea3-51f0ff4458c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:00.300798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870aed7-6ed9-43a8-aea3-51f0ff4458c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:00.301105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870aed7-6ed9-43a8-aea3-51f0ff4458c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:00.302572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870aed7-6ed9-43a8-aea3-51f0ff4458c0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:00.316600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 368/718] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:00.323650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:00.450861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56473e-5a82-420a-8bcc-8b36ad7576df None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:00.486563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c389c44-9ec9-4d1a-aadf-cab8f39e0a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:00.487216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389c44-9ec9-4d1a-aadf-cab8f39e0a62 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:00.487498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389c44-9ec9-4d1a-aadf-cab8f39e0a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:00.487771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c389c44-9ec9-4d1a-aadf-cab8f39e0a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:00.488596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389c44-9ec9-4d1a-aadf-cab8f39e0a62 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=85186f8437164bbbb99e007b5c85bd54) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:00.488901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389c44-9ec9-4d1a-aadf-cab8f39e0a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:00.490353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c389c44-9ec9-4d1a-aadf-cab8f39e0a62 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:00.498960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:00.502639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 351/719] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:00 2022] GET /identity/v3/role_assignments?user.id=85186f8437164bbbb99e007b5c85bd54&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:00.960978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfff64-4971-46dd-9e0a-42b0fd417dcf None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:00.962204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfff64-4971-46dd-9e0a-42b0fd417dcf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:00.962722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfff64-4971-46dd-9e0a-42b0fd417dcf None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:00.965304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 369/720] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:00.971277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4ccd6-fb3a-408f-b7c3-398dba87ea98 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:00.972219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4ccd6-fb3a-408f-b7c3-398dba87ea98 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:00.972716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4ccd6-fb3a-408f-b7c3-398dba87ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:00.991841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6bd4ccd6-fb3a-408f-b7c3-398dba87ea98 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:00.993604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6bd4ccd6-fb3a-408f-b7c3-398dba87ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:01.095116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 352/721] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:55:01.129324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfff64-4971-46dd-9e0a-42b0fd417dcf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:01.181121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:01.254614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfff64-4971-46dd-9e0a-42b0fd417dcf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:01.292635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:01.293920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:01.294403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:01.294879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:01.306702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:01.314735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:01.315641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:01.316465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:01.319717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 370/722] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:01.325364 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4ccd6-fb3a-408f-b7c3-398dba87ea98 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:01.491162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4ccd6-fb3a-408f-b7c3-398dba87ea98 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:01.519925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:01.529869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6825df-a88b-4667-b5b5-212cce9a4060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:01.530543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6825df-a88b-4667-b5b5-212cce9a4060 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:01.530830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6825df-a88b-4667-b5b5-212cce9a4060 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:01.531108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6825df-a88b-4667-b5b5-212cce9a4060 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:01.531871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6825df-a88b-4667-b5b5-212cce9a4060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:01.532185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6825df-a88b-4667-b5b5-212cce9a4060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:01.533621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6825df-a88b-4667-b5b5-212cce9a4060 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:01.547213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 353/723] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:01.552394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:01.697263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c22c55-588b-41a9-82c6-e31489816aa2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:01.705875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:01.734654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:01.735771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:01.736252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:01.736730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:01.748305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:01.750082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:01.768678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:01.769685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:01.770736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:01.770736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:01.770736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:01.770736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:01.773855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 371/724] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:01.775677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28c23-420d-4283-854b-9acfc0ecc2ee None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:01.776187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28c23-420d-4283-854b-9acfc0ecc2ee None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:01.776665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28c23-420d-4283-854b-9acfc0ecc2ee None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:01.779096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:01.783855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 354/725] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:01.790439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd23da-ac16-43c4-a4fe-8dd40eb3e43a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:01.791062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd23da-ac16-43c4-a4fe-8dd40eb3e43a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:01.791543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd23da-ac16-43c4-a4fe-8dd40eb3e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:01.824223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5bdd23da-ac16-43c4-a4fe-8dd40eb3e43a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:01.827049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5bdd23da-ac16-43c4-a4fe-8dd40eb3e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:01.967952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 355/726] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:55:01.974702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27130c-54f2-4aa0-b2bd-d16fc704a507 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.007444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd23da-ac16-43c4-a4fe-8dd40eb3e43a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.030496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23a6f5-3145-4ecf-b04a-032a2e0fedc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.031506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a6f5-3145-4ecf-b04a-032a2e0fedc6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.032175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a6f5-3145-4ecf-b04a-032a2e0fedc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.032823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23a6f5-3145-4ecf-b04a-032a2e0fedc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.034579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a6f5-3145-4ecf-b04a-032a2e0fedc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:02.034910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a6f5-3145-4ecf-b04a-032a2e0fedc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.036303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23a6f5-3145-4ecf-b04a-032a2e0fedc6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.049580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 372/727] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:02.051323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6beb9-eb2d-4d4a-a884-c2c1dff544f1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.051642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6beb9-eb2d-4d4a-a884-c2c1dff544f1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.051930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6beb9-eb2d-4d4a-a884-c2c1dff544f1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.057380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 373/728] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:02.057380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6beb9-eb2d-4d4a-a884-c2c1dff544f1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.073007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:02.161372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd23da-ac16-43c4-a4fe-8dd40eb3e43a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.192243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:02.205507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6beb9-eb2d-4d4a-a884-c2c1dff544f1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.213977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470f65f-34df-43d9-a933-4bf9bbc6fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.215392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f65f-34df-43d9-a933-4bf9bbc6fcda None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.215774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f65f-34df-43d9-a933-4bf9bbc6fcda None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.216172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470f65f-34df-43d9-a933-4bf9bbc6fcda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.229917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470f65f-34df-43d9-a933-4bf9bbc6fcda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6470f65f-34df-43d9-a933-4bf9bbc6fcda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:02.243087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:02.244213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:55:02.245036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:02.249415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 356/729] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:55:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:02.250979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df28b5-9bf3-42a7-ac27-fa0fa56f6bca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.251453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df28b5-9bf3-42a7-ac27-fa0fa56f6bca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.251913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df28b5-9bf3-42a7-ac27-fa0fa56f6bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.255318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.256266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.257309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.257846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.267472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.269033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.271165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-64df28b5-9bf3-42a7-ac27-fa0fa56f6bca None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:02.272709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-64df28b5-9bf3-42a7-ac27-fa0fa56f6bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:02.286722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:02.287637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:02.288831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 374/730] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:02.289455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.358379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 357/731] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:55:02.359617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df28b5-9bf3-42a7-ac27-fa0fa56f6bca None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.385732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:02.432807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf69f-2573-4858-8994-bace60d0eda0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.483424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df28b5-9bf3-42a7-ac27-fa0fa56f6bca None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.483808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.484663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.485403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.486746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.487683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:02.488164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.489728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.498496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:02.503656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 375/732] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:55:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:02.504685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.522821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.523854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.524273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.524560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.525739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:02.525896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.527462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.556034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 358/733] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 13:55:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:02.556034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.625992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d63d1-b753-4133-a560-c62788336906 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.655018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:02.661487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.662147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.662428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.663220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.664187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.665660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.672500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79ebe9-25c2-4ab2-8e60-413c07cb5749 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.693379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 376/734] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:02 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:02.693379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.728110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc753579-1cb2-4d6d-aad5-65e865c3631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.729494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc753579-1cb2-4d6d-aad5-65e865c3631f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.730069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc753579-1cb2-4d6d-aad5-65e865c3631f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.730581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc753579-1cb2-4d6d-aad5-65e865c3631f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.746832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc753579-1cb2-4d6d-aad5-65e865c3631f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.749144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc753579-1cb2-4d6d-aad5-65e865c3631f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cc753579-1cb2-4d6d-aad5-65e865c3631f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:02.779906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:02.780862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:02.781758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:02.781758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:02.781758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:02.781758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:02.782566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 359/735] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:02.784366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203454-f383-4217-b12c-81e62a583f3c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.784555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203454-f383-4217-b12c-81e62a583f3c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.784895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203454-f383-4217-b12c-81e62a583f3c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.786964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 360/736] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:02.788097 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203454-f383-4217-b12c-81e62a583f3c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:02.825882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:02.836109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46164bf-03c6-4fa2-800a-182b8f1f7c18 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.884256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.884919 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.885204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.885527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.931743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203454-f383-4217-b12c-81e62a583f3c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:02.957720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:02.969959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.971436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.972845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bca0b-48c2-4f20-a283-ec3ea6d0a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:02.973540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bca0b-48c2-4f20-a283-ec3ea6d0a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.973822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bca0b-48c2-4f20-a283-ec3ea6d0a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.974443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bca0b-48c2-4f20-a283-ec3ea6d0a0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:02.975383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bca0b-48c2-4f20-a283-ec3ea6d0a0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:02.975986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bca0b-48c2-4f20-a283-ec3ea6d0a0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:02.977640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bca0b-48c2-4f20-a283-ec3ea6d0a0f1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:02.991568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 361/737] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:02.992760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f85a6-a717-4d29-9be9-98af6c62c64d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:02.993049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f85a6-a717-4d29-9be9-98af6c62c64d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:02.993327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f85a6-a717-4d29-9be9-98af6c62c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.009704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-da7f85a6-a717-4d29-9be9-98af6c62c64d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:03.010885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da7f85a6-a717-4d29-9be9-98af6c62c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:03.085637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 362/738] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:55:03.087345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 377/739] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:02 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 13:55:03.088800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.091867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c6ca-237e-4da3-a77c-502d45dc4c01 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.092181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c6ca-237e-4da3-a77c-502d45dc4c01 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.092442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470c6ca-237e-4da3-a77c-502d45dc4c01 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.097399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 363/740] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:03.097399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470c6ca-237e-4da3-a77c-502d45dc4c01 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.110638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:03.201681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:03.212428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a540bd-a446-4b63-b2ac-6dc38af02f43 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.213934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470c6ca-237e-4da3-a77c-502d45dc4c01 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.248642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06467e-26b5-4dea-8ef4-94b81c527704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.249538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06467e-26b5-4dea-8ef4-94b81c527704 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.249824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06467e-26b5-4dea-8ef4-94b81c527704 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.250108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06467e-26b5-4dea-8ef4-94b81c527704 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.250659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.251450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.251737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.252018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.259659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06467e-26b5-4dea-8ef4-94b81c527704 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:03.262355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06467e-26b5-4dea-8ef4-94b81c527704 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:03.263921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:03.265641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-cc06467e-26b5-4dea-8ef4-94b81c527704 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:03.282264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:03.283281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:03.284234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:03.288595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 378/741] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:03.290005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0125c-9140-479b-8262-41b682b5079f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.290289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0125c-9140-479b-8262-41b682b5079f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:03.290401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:03.291408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:03.297164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:03.297164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:03.297164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:03.297164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:03.297488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0125c-9140-479b-8262-41b682b5079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.297575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 364/742] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:03.297575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.312462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-eef0125c-9140-479b-8262-41b682b5079f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:03.313679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eef0125c-9140-479b-8262-41b682b5079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:03.358272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:03.387532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 379/743] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 13:55:03.394255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0125c-9140-479b-8262-41b682b5079f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.411916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d2fb1-436c-47c7-b8a7-518383b9001b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.450849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.451796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.452076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.452347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.453063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:03.454471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:03.474569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 365/744] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:03 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:03.476160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.483428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:03.506212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0125c-9140-479b-8262-41b682b5079f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.557909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.558630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.558918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.559199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.560391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:03.560391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:03.562021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:03.583363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 380/745] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:03.588818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.625765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c6fd-3f67-4091-abcb-76c238d97537 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.651227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:03.677398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.679094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.679094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.679265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.680316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:03.680626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:03.682040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:03.696025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 366/746] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:03.696540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.725023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc436573-39d5-4695-bea0-d7f51d962c07 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.764482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.765661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.766170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.766637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.768850 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:03.781363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:03.790513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:03.791443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:03.792265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:03.799743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 381/747] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:03.801009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:03.806264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4123bde-7154-47f7-b2aa-ae19d426afa5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.843209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.843865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.844148 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.844424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.896762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:03.918430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a59d5-3f06-488a-864a-9f33f184d3ef None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:03.918770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:03.920140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:03.958849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:03.960604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:03.961086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:03.961601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:03.969396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:03.971360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:03.987683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:03.988691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:03.989662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:03.993605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 382/748] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:03.994775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.035672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 367/749] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:04.035672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.063786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:04.113358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8f639-6f41-4b05-9210-019b0e249ea2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.127559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:04.149054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdb21d-ba59-475d-acc4-7bbecc2d45a4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.152207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.152978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.153376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.153746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.154594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:04.155013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.156535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.171092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 383/750] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:04.172079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.187657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.188561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.189011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.189492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.190424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:04.190903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.192547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.206300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 368/751] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:04.207337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.282929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029724aa-2bf7-46d0-a46d-2fcda4433eda None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.314665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78ce8f-dbc8-4e54-b8a5-579bb36f29be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.317742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:04.322012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.323014 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.323750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.324077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.338665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.340397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.352606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.353515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.353872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.354219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:04.360874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:04.361890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:04.362961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:04.362961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:04.362961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:04.362961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:04.367251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.368395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 384/752] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:04.368973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.369473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.369740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:04.388402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:04.389572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:04.390648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:04.390648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:04.390648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:04.390648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:04.392173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 369/753] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:04.393156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.487232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e5a4-f1c6-432c-98c4-add511b90d1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.501925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be6fd8-2e5d-4486-a21a-c002a17d1265 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.525179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.526185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.526706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.527209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.528316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=38d55235b0374bfa8ea73ac3f4e2836b) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:04.528766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.530476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.538153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 385/754] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/role_assignments?user.id=38d55235b0374bfa8ea73ac3f4e2836b&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:04.539251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.546169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.546999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.547379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.547753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.548593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:04.549001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.550634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.579004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 370/755] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:04.589558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.617753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:04.661265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af15f09-8c39-4d38-8506-484cbace6f2b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.689004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:04.704040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.705182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.705678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.706180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.707216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:04.707805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.709955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.727841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 386/756] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:04.730617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.844945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d7380-8376-4040-909e-0c2b63f3541a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.845282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2af788-d5e3-485d-886f-ddea945f2f3c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:04.857580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:04.883187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe84c38-8680-4565-ac73-188586543ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.883986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe84c38-8680-4565-ac73-188586543ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.884265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe84c38-8680-4565-ac73-188586543ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.884540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe84c38-8680-4565-ac73-188586543ec4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.892133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe84c38-8680-4565-ac73-188586543ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.893768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe84c38-8680-4565-ac73-188586543ec4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.900204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464e3cc-2bd3-4c71-b7de-6db48c462581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:04.901008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e3cc-2bd3-4c71-b7de-6db48c462581 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.901291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e3cc-2bd3-4c71-b7de-6db48c462581 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.901815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464e3cc-2bd3-4c71-b7de-6db48c462581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.908882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e3cc-2bd3-4c71-b7de-6db48c462581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:04.910363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464e3cc-2bd3-4c71-b7de-6db48c462581 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6fe84c38-8680-4565-ac73-188586543ec4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:04.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:04.914385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:04.915308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:04.919203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 387/757] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:04.920515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794df78-2464-4db3-8eec-003da48c8c05 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.920800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794df78-2464-4db3-8eec-003da48c8c05 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.921078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794df78-2464-4db3-8eec-003da48c8c05 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.922853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 388/758] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:04.923846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794df78-2464-4db3-8eec-003da48c8c05 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0464e3cc-2bd3-4c71-b7de-6db48c462581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:04.925493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:04.927232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 371/759] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd5b2-7579-4257-bf4a-24acaa93f3ad None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:04.929862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd5b2-7579-4257-bf4a-24acaa93f3ad None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:04.930759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd5b2-7579-4257-bf4a-24acaa93f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:04.955845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-737cd5b2-7579-4257-bf4a-24acaa93f3ad None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:04.957579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-737cd5b2-7579-4257-bf4a-24acaa93f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:05.046675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 372/760] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:05.047688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd5b2-7579-4257-bf4a-24acaa93f3ad None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.053400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794df78-2464-4db3-8eec-003da48c8c05 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.092639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.092639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.092639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.092639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.093442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:05.093591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.095070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.102005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:05.119773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 389/761] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:55:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:05.120689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.134572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:05.174913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd5b2-7579-4257-bf4a-24acaa93f3ad None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.218951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.220073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.220563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.221047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.222111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:05.222641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.224375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.245034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 373/762] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:05.246591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.354977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16f21a-f730-48fb-af09-36026c96f58e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.386094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f92663-8bd7-475e-9162-16845ecd33a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.388693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:05.392578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.393413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.393697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.393973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.394693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.396124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:05.414225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:05.415224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:05.416043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 390/763] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:05.416877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.435612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.437014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.437943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.438515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.454901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.457513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:05.480403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:05.481333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:05.482250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:05.482250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:05.482250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:05.482250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:05.483038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 374/764] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:05.483808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.503897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:05.531818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc95452-a6b6-43fa-acf3-dbeafdcdc038 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.569719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.570763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.571069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.571323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.572155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=00828d68497c433d80fa2155b21adff4) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:05.572708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.575199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.589003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 391/765] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/role_assignments?user.id=00828d68497c433d80fa2155b21adff4&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:05.590867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.661159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5c227-63e8-4d11-8a2f-85f4fab26e2d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.723544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87425df0-c5b6-4d28-b86a-d3ab1e41a35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.724300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87425df0-c5b6-4d28-b86a-d3ab1e41a35d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.724579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87425df0-c5b6-4d28-b86a-d3ab1e41a35d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.724857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87425df0-c5b6-4d28-b86a-d3ab1e41a35d None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.726949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87425df0-c5b6-4d28-b86a-d3ab1e41a35d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:05.727346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87425df0-c5b6-4d28-b86a-d3ab1e41a35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.728763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87425df0-c5b6-4d28-b86a-d3ab1e41a35d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.739838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 375/766] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:05.741425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccd40d-7536-472c-9932-bac90c81184a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.741716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccd40d-7536-472c-9932-bac90c81184a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.741999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccd40d-7536-472c-9932-bac90c81184a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.743667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 376/767] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:05.744446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccd40d-7536-472c-9932-bac90c81184a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.770885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:05.778412 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dfc91-6b4a-42e7-852d-719357048691 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.830651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c893d-3981-4db3-a0b1-9f58f1aeb24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.831346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c893d-3981-4db3-a0b1-9f58f1aeb24b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.831624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c893d-3981-4db3-a0b1-9f58f1aeb24b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.831896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c893d-3981-4db3-a0b1-9f58f1aeb24b None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.832896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c893d-3981-4db3-a0b1-9f58f1aeb24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:05.833198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c893d-3981-4db3-a0b1-9f58f1aeb24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.835760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c893d-3981-4db3-a0b1-9f58f1aeb24b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.845106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:05.853446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 392/768] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:05.855103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c8725-7ad0-4171-8470-fc97dc62c104 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.857066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c8725-7ad0-4171-8470-fc97dc62c104 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.857634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c8725-7ad0-4171-8470-fc97dc62c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.882427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d21c8725-7ad0-4171-8470-fc97dc62c104 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:05.883846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d21c8725-7ad0-4171-8470-fc97dc62c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:05.885402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccd40d-7536-472c-9932-bac90c81184a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:05.922269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:05.923347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:05.923848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:05.924327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:05.925270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:05.925865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:05.927461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:05.934014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 377/769] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:05.935072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:05.959998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 393/770] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:05.960945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c8725-7ad0-4171-8470-fc97dc62c104 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.029007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:06.049061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876120e-998e-4b00-905f-4acbca48527e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.073247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c8725-7ad0-4171-8470-fc97dc62c104 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.090989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.092160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.092650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.093156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.101317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.102846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:06.103708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.111707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.112367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.112644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.112918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.113747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] RBAC: Adding query filter params (interface=public, service_id=1afac0974441489692a3b2d537619cdf, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:06.114053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.115400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:06.122032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:06.122944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:06.123824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:06.124256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 394/771] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/endpoints?service_id=1afac0974441489692a3b2d537619cdf&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:06.125122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.126860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 378/772] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:06.129041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.238431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922cf14-a8d9-4c55-80f7-659f5f69319b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.239082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794fa0e-a0d8-4bf6-956f-6a3ea159d3ef None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.278254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.279093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.279316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.279590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] PATH_INFO: `/v3/services/network` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.280342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.282024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.284058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.285038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.285561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.286038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.286918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.289558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:06.295136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:06.296102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:06.296940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 395/773] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:06 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:06.297747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.298806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 379/774] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:06 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:06.302171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.317761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:06.427153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:06.435810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5b31-2b93-4d23-8f14-333d7eca5dd7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.474656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.476536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.477087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.477607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.478594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] RBAC: Adding query filter params (name=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:06.479133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.480777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.486756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 380/775] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:06.494555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.519404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab81d8a-4b3c-4598-ad36-16ac0f0311db None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.557779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.558497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.558776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.559050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.559834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:06.560137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.562422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.576814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 396/776] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:06.585273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.604163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:06.643490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded82d38-0b18-4f02-9d27-f3b0b2466559 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.683745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.684428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.684711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.684988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.689816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:06.690139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.691538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.694833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6c92f-45f2-4859-89fd-43cf1c1a52e1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.705544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 381/777] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:06.712532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:06.715240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:06.734368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4de94c-a31c-4c52-bd19-bf5395cc6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.735272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de94c-a31c-4c52-bd19-bf5395cc6c24 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.735572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de94c-a31c-4c52-bd19-bf5395cc6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.735891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4de94c-a31c-4c52-bd19-bf5395cc6c24 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/85186f8437164bbbb99e007b5c85bd54/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.737962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4de94c-a31c-4c52-bd19-bf5395cc6c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=85186f8437164bbbb99e007b5c85bd54, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.739472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4de94c-a31c-4c52-bd19-bf5395cc6c24 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.769538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 397/778] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:55:06 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/85186f8437164bbbb99e007b5c85bd54/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:55:06.870281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901878dc-ffa8-4de1-89fc-b9305a617f70 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.870632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901878dc-ffa8-4de1-89fc-b9305a617f70 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.870844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901878dc-ffa8-4de1-89fc-b9305a617f70 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.872502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 398/779] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:06.877976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c80b-42d1-43cd-949f-f18bfca89162 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.878263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c80b-42d1-43cd-949f-f18bfca89162 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.878638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c80b-42d1-43cd-949f-f18bfca89162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.892579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29748dd-5ef1-4024-ade2-c5cddb2d0a0b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:06.920779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bd67c80b-42d1-43cd-949f-f18bfca89162 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:06.922621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd67c80b-42d1-43cd-949f-f18bfca89162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:06.933378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:06.934064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:06.934348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:06.934626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:06.939923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] RBAC: Adding query filter params (interface=public, service_id=59cc1fc00a504172b32505d254fb3888, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:06.939923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:06.939923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:06.948863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 382/780] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:55:06 2022] GET /identity/v3/endpoints?service_id=59cc1fc00a504172b32505d254fb3888&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:06.949878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:06.954549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:07.065602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 399/781] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:07.085645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c80b-42d1-43cd-949f-f18bfca89162 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:07.101051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ee9b-ce08-43c6-a161-a38ada2794e0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:07.136579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:07.137379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:07.137658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:07.137980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:07.138669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:07.140030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:07.145688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 383/782] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:06 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:07.202847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c80b-42d1-43cd-949f-f18bfca89162 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:07.211958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:07.259297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:07.260129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:07.260405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:07.260673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:07.273188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:07.281144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:07.282190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:07.283033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 400/783] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:07.289322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:07.378899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:07.420669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192207e0-2052-4513-88c7-ffd766d03f04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:07.457111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:07.457815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:07.458093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:07.458559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:07.459894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:07.460239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:07.461647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:07.470873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 384/784] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:07.476799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:07.584324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef26806-27db-4fde-8d8c-f01518896d40 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:07.619328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:07.620166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:07.620445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:07.620716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:07.631440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:07.632898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:07.650892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:07.652977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:07.654132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:07.654132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:07.654132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:07.654132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:07.654132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 401/785] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:07.657909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:07.764219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545e2c1-c25a-41f2-8e66-2f3007c210a5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:07.788653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:07.807750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38906af2-226b-4e5c-b43d-a75fa683c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:07.808431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906af2-226b-4e5c-b43d-a75fa683c23a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:07.808707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906af2-226b-4e5c-b43d-a75fa683c23a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:07.808977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38906af2-226b-4e5c-b43d-a75fa683c23a None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:07.809738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906af2-226b-4e5c-b43d-a75fa683c23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:07.810038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906af2-226b-4e5c-b43d-a75fa683c23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:07.811428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38906af2-226b-4e5c-b43d-a75fa683c23a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:07.830358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 385/786] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:07.836900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:07.874549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:07.949531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31f120-47cd-4db7-a8ab-d52a3fd4f66a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:07.949826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31f120-47cd-4db7-a8ab-d52a3fd4f66a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:07.949986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31f120-47cd-4db7-a8ab-d52a3fd4f66a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:07.952614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 386/787] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:07.958031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec34d-a39d-4cbe-95e6-e4b846816624 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:07.958798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec34d-a39d-4cbe-95e6-e4b846816624 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:07.959082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec34d-a39d-4cbe-95e6-e4b846816624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:07.978758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b34ec34d-a39d-4cbe-95e6-e4b846816624 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:07.980097 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b34ec34d-a39d-4cbe-95e6-e4b846816624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:08.003868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef64b1-46aa-44f0-bdd0-8c395a4459bc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:08.060420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 387/788] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:08.084070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec34d-a39d-4cbe-95e6-e4b846816624 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:08.086861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:08.087783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.088070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.088345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.102749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:08.104213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:08.134373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:08.135374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:08.136315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 402/789] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:08.141364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:08.195008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec34d-a39d-4cbe-95e6-e4b846816624 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:08.225811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:08.233701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:08.234797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.235086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.235361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.247658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:08.256470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:08.257520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:55:08.258338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:08.259747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 388/790] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:08.264300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:08.365278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:08.409867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bc396-6881-462b-9b68-f1be1935ce91 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:08.439784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbc1a-77ca-4f06-82c9-01cfa197c756 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:08.481481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:08.482082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.482358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.482626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.483461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:08.483764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:08.485181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:08.514945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:08.515626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.515903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.516179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.516922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:08.517103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 403/791] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:08.517212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:08.518688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:08.522692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:08.528684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 389/792] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:08.534333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:08.575320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:08.645531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b531c00-76ef-4d73-ba38-af8b554a8e0f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:08.681146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:08.681987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.682265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.682543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.695284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:08.696755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:08.725753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:08.726697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:08.727580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:08.727580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:08.727580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:08.727580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:08.727580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 390/793] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:08.740000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:08.795118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8f2b5-cb0e-4957-aaf2-d2dc586fde3e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:08.867212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:08.877849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89916c8-88e5-4879-9927-1c3d574c46a0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:08.917336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:08.918357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.918832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.919321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.920580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:08.921103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:08.922777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:08.929560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f702975-7e02-4a42-94b4-d01a86e4626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:08.930428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f702975-7e02-4a42-94b4-d01a86e4626b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.930715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f702975-7e02-4a42-94b4-d01a86e4626b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.930991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f702975-7e02-4a42-94b4-d01a86e4626b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.937070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 391/794] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:08.943664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:08.952013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:08.962912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f702975-7e02-4a42-94b4-d01a86e4626b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:08.964381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f702975-7e02-4a42-94b4-d01a86e4626b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7f702975-7e02-4a42-94b4-d01a86e4626b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:08.986141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:08.987067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:08.987969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:08.987969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:08.987969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:08.987969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:08.987969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 404/795] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:08.988860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137b3f-9cbc-429e-9738-4a5a393153f3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:08.989145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137b3f-9cbc-429e-9738-4a5a393153f3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:08.994272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0137b3f-9cbc-429e-9738-4a5a393153f3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:08.995860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 405/796] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:09.000319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137b3f-9cbc-429e-9738-4a5a393153f3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.074358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f892ac-e534-4d6a-8c2d-b6461047a7e8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.125880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce778a0-a3cb-4e31-8e5d-8f4506080661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.127317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce778a0-a3cb-4e31-8e5d-8f4506080661 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.128100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce778a0-a3cb-4e31-8e5d-8f4506080661 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.128999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce778a0-a3cb-4e31-8e5d-8f4506080661 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.139149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0137b3f-9cbc-429e-9738-4a5a393153f3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.139318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce778a0-a3cb-4e31-8e5d-8f4506080661 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.141298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce778a0-a3cb-4e31-8e5d-8f4506080661 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0ce778a0-a3cb-4e31-8e5d-8f4506080661 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:09.162730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:09.163727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:09.164664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:09.167431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 392/797] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:09.168818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aadb7c-c1dc-45e0-8cd6-4e38f52e64a9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.169239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aadb7c-c1dc-45e0-8cd6-4e38f52e64a9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.169781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aadb7c-c1dc-45e0-8cd6-4e38f52e64a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.185278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.186126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.186531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.186901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.187746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:09.188153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.189642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.192103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b1aadb7c-c1dc-45e0-8cd6-4e38f52e64a9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:09.194115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1aadb7c-c1dc-45e0-8cd6-4e38f52e64a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:09.196394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:09.208860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 406/798] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:09.210896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.281182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:09.285086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 393/799] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:09.286290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aadb7c-c1dc-45e0-8cd6-4e38f52e64a9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.362258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c72bd6-5293-4766-86bf-6419e8044d21 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.406086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.407211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.407497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.407776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.408614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:09.408923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.409940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aadb7c-c1dc-45e0-8cd6-4e38f52e64a9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.410375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.434686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 407/800] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 13:55:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:09.434686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.451853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615168cf-ae98-414b-85d2-144534dc003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.452733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615168cf-ae98-414b-85d2-144534dc003c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.453020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615168cf-ae98-414b-85d2-144534dc003c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.453295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615168cf-ae98-414b-85d2-144534dc003c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.461619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615168cf-ae98-414b-85d2-144534dc003c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.463190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615168cf-ae98-414b-85d2-144534dc003c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.465232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-615168cf-ae98-414b-85d2-144534dc003c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:09.480114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:09.481018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:09.481938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 394/801] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:09.482895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af16bb-fdc9-4bce-8983-e3af53bd5aa9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.482895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af16bb-fdc9-4bce-8983-e3af53bd5aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.483073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af16bb-fdc9-4bce-8983-e3af53bd5aa9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.488359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 395/802] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:09.488359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af16bb-fdc9-4bce-8983-e3af53bd5aa9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.549057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b141c-bf1f-4409-ad8c-b68b927b394a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.558187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:09.586812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.588056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.588343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.588621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.589474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.590849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.601626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af16bb-fdc9-4bce-8983-e3af53bd5aa9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:09.604996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:09.605938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:09.606788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 408/803] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Jul 18 13:55:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:09.607628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.644207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bba27-fe66-442d-b7ef-b3b7782a7694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.645010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bba27-fe66-442d-b7ef-b3b7782a7694 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.645292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bba27-fe66-442d-b7ef-b3b7782a7694 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.645611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bba27-fe66-442d-b7ef-b3b7782a7694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.658227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bba27-fe66-442d-b7ef-b3b7782a7694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.659689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bba27-fe66-442d-b7ef-b3b7782a7694 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-010bba27-fe66-442d-b7ef-b3b7782a7694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:09.679240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:09.680176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:09.681091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:09.681091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:09.681091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:09.681091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:09.681091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 396/804] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:09.681733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c424-02d2-4d52-b94e-24fa56ab7e5a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.682023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c424-02d2-4d52-b94e-24fa56ab7e5a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.682297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c424-02d2-4d52-b94e-24fa56ab7e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.699198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c625c424-02d2-4d52-b94e-24fa56ab7e5a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:09.700381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c625c424-02d2-4d52-b94e-24fa56ab7e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:09.718349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870968bc-7ad8-41fd-af8c-d01fffadc99a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.747646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:09.752680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e70b6f-701b-4e8e-9213-88f7e9cd74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.753339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e70b6f-701b-4e8e-9213-88f7e9cd74fe None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.753650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e70b6f-701b-4e8e-9213-88f7e9cd74fe None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.753924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e70b6f-701b-4e8e-9213-88f7e9cd74fe None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.754705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e70b6f-701b-4e8e-9213-88f7e9cd74fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:09.755013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e70b6f-701b-4e8e-9213-88f7e9cd74fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.757281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e70b6f-701b-4e8e-9213-88f7e9cd74fe None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.768945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 397/805] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:09.769431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 409/806] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:09.769801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c424-02d2-4d52-b94e-24fa56ab7e5a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.770511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718d0e-d878-4418-9e4b-da5157773a33 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.770798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718d0e-d878-4418-9e4b-da5157773a33 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.771073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c718d0e-d878-4418-9e4b-da5157773a33 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.772410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 410/807] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:09.773099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718d0e-d878-4418-9e4b-da5157773a33 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.811759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:09.885684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c718d0e-d878-4418-9e4b-da5157773a33 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.889265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c424-02d2-4d52-b94e-24fa56ab7e5a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:09.919025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.919673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.919953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.920234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.920941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:09.921241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.922630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.923615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dbc1c-db99-4ba5-8342-854baa43c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:09.924284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dbc1c-db99-4ba5-8342-854baa43c701 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.924569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dbc1c-db99-4ba5-8342-854baa43c701 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.924852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dbc1c-db99-4ba5-8342-854baa43c701 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.925585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dbc1c-db99-4ba5-8342-854baa43c701 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:09.925895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dbc1c-db99-4ba5-8342-854baa43c701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:09.927259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3dbc1c-db99-4ba5-8342-854baa43c701 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:09.932523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 398/808] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 13:55:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:09.933838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a002-745b-431e-b2f8-ea28c0c2fa81 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:09.934133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a002-745b-431e-b2f8-ea28c0c2fa81 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:09.934413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a002-745b-431e-b2f8-ea28c0c2fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:09.935038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 411/809] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:09.935947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:09.952986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4e46a002-745b-431e-b2f8-ea28c0c2fa81 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:09.954226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e46a002-745b-431e-b2f8-ea28c0c2fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:09.993105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.019873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 399/810] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:10.020692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a002-745b-431e-b2f8-ea28c0c2fa81 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.028197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.039253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19cc3e-fa51-4773-9f23-5422e6eb4511 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.076268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.077266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.077674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.078046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/38d55235b0374bfa8ea73ac3f4e2836b/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.080193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=38d55235b0374bfa8ea73ac3f4e2836b, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.081769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.095822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 412/811] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:55:09 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/38d55235b0374bfa8ea73ac3f4e2836b/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:55:10.096421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.158824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a002-745b-431e-b2f8-ea28c0c2fa81 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.199441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.200250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.200556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.200798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.214438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:10.217483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370fe37-c57e-4590-8934-3e76532c3175 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:10.222347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:10.223347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:10.224198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 400/812] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:10.225662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.268134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.268812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.269096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.269456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.270177 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:10.270498 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.270673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.272723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.285976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 413/813] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:10.286895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.304623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.346878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e35dd-d10a-45a6-a131-3dc8e7bb4d82 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.396019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.397418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.397728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.398010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.405571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.407047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.415475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39cf3-6914-4d68-b6d3-f80620511a4c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:10.422448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:10.423316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:10.424242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 401/814] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:10.424723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.458126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.459422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.459726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.460001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] PATH_INFO: `/v3/services/network` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.460656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.462074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:10.474004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:10.475772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:10.476879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 414/815] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:10.477720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.536929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.545752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2d663-9e74-46b1-964c-2233389bcf05 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.561280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.584651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3d328-b7dc-471c-93e2-8ccba7384aff None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.589898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.590642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.590924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.591199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.592019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:10.592809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.594669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.604381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 402/816] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:10.605151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.624735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.625505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.625792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.626069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.626808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.628174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.657372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 415/817] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:10.657372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.730958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9d2d4-177b-4198-bc7a-f685ef7338fd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.779060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.780347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.780699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.781070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.782659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:10.783169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.785053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.804647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 403/818] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:10.806095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.814097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038a932-a2b3-4691-a88c-a5df2f2ab744 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.826358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.865877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.866653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.867041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.867419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:10.868248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] RBAC: Adding query filter params (name=network) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:10.868553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:10.870548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:10.872670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:10.875569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 416/819] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:10.877380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:10.954114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb31f6f-bb6f-4674-a585-a8da6ea214be None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:10.994358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:10.995582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:10.996010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:10.996430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:11.001561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c63cb6-dac3-47e7-94af-a3a8dd6e0985 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:11.007993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:11.009798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:11.028862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:11.029970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:11.031146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:11.031146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:11.031146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:11.031146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:11.033157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 404/820] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:11.034230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:11.044975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:11.046319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:11.046319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:11.046928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/00828d68497c433d80fa2155b21adff4/roles/17da537249e74814b7c89c0c614f5da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:11.063893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=00828d68497c433d80fa2155b21adff4, role_id=17da537249e74814b7c89c0c614f5da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:11.065728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:11.093466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 417/821] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:55:10 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/00828d68497c433d80fa2155b21adff4/roles/17da537249e74814b7c89c0c614f5da3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:55:11.094912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:11.112359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:11.155628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6dd87-5cee-409f-ae09-bf8b31a019da None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:11.193058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:11.199797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:11.201310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:11.201765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:11.202252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:11.203106 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] RBAC: Adding query filter params (type=network) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:11.203615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:11.205158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:11.213028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 405/822] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:11.219304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:11.358517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e093d-df9a-48ee-8703-4c59edb3901d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:11.359093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb72c7-e8ff-463e-b8af-5fda9ad067a3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:11.403560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:11.404509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:11.404965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:11.405453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:11.406454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:11.409552 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:11.411880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:11.450021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:11.450753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:11.451320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:11.451670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:11.452468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:11.452778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:11.453703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 406/823] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:11.455546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:11.472064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 418/824] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:11.478740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:11.719963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbed8-5c62-4728-8c0a-4fa738f72aea None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:11.767951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:11.768757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:11.769041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:11.769319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:11.780082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:11.781585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:11.798265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:11.799410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:11.800736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:11.806522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:11.815848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 407/825] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:55:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:11.918773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d45904-9f81-41dd-9f22-40afe03e23e8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:11.929103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:11.972040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb52f36-8cab-4bc2-8903-2153279c9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:11.972644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52f36-8cab-4bc2-8903-2153279c9392 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:11.972927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52f36-8cab-4bc2-8903-2153279c9392 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:11.973206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb52f36-8cab-4bc2-8903-2153279c9392 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:11.974085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb52f36-8cab-4bc2-8903-2153279c9392 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:11.974395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb52f36-8cab-4bc2-8903-2153279c9392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:11.975960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb52f36-8cab-4bc2-8903-2153279c9392 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:12.003927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.007180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 419/826] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:55:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:12.074012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:12.155711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085063-c654-4f0f-85d6-a2fdcb1be9c1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:12.191771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:12.192430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.192716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.192996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.267698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:12.269925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:12.303139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a51739-728c-4edc-aaef-8c58dcc8188d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.303397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a51739-728c-4edc-aaef-8c58dcc8188d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.303699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a51739-728c-4edc-aaef-8c58dcc8188d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.305210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 420/827] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:12.310302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779d90a-a955-4b7b-b884-11fda38084f2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.310511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779d90a-a955-4b7b-b884-11fda38084f2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.310726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779d90a-a955-4b7b-b884-11fda38084f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.319131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:12.328580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b779d90a-a955-4b7b-b884-11fda38084f2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:12.329809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b779d90a-a955-4b7b-b884-11fda38084f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:12.403055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 408/828] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 13:55:12.403941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 421/829] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:12.412511 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.421932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779d90a-a955-4b7b-b884-11fda38084f2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.533477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:12.539502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45bd2d-5dcb-48ae-a99f-45a52112b15b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:12.541524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779d90a-a955-4b7b-b884-11fda38084f2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:12.585928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:12.586164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:12.586728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.587015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.587296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.587844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.588337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.588805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.597534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:12.600846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:12.602639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:12.603847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:12.612188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:12.613116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:12.613987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:12.616775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 422/830] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:12.622100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:12.622379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:12.623206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:12.624182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:12.624182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:12.624182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:12.624182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:12.625486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 409/831] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:12.629176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.738379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b1a7b-4ce2-43ea-8c35-c382c9e67779 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:12.739283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a863b3c-5168-45b9-a54e-c228902deb1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:12.776579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:12.777159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:12.777879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.778116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.778217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.778429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.778883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.779184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:12.779492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:12.779770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.780691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:12.780858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:12.781372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:12.782918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:12.790596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 423/832] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:12.796049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.797674 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 410/833] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:12.807721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.819316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:12.873781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:12.904507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df15f23-b82f-43e7-9008-17a3035e4a70 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:12.921883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4e6c6-661d-46e5-957a-feb5bc868cd4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:12.941034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:12.941855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.942130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.942407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.954184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:12.955720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:12.962587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca6ca2-676e-497b-8c65-5f4d1c8304c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:12.963737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca6ca2-676e-497b-8c65-5f4d1c8304c7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.964217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca6ca2-676e-497b-8c65-5f4d1c8304c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.964832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca6ca2-676e-497b-8c65-5f4d1c8304c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.972254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca6ca2-676e-497b-8c65-5f4d1c8304c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:12.974008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca6ca2-676e-497b-8c65-5f4d1c8304c7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:12.974893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:12.975754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:12.976639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:12.976639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:12.976639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:12.976639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:12.980935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 424/834] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:12.981811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-04ca6ca2-676e-497b-8c65-5f4d1c8304c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:12.992617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:12.993653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:12.994635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:12.998171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 411/835] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:12.998171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e317f1-6127-4787-841b-83e5c47fcdeb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:12.998171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e317f1-6127-4787-841b-83e5c47fcdeb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:12.998171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e317f1-6127-4787-841b-83e5c47fcdeb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:12.999863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 412/836] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:13.000892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e317f1-6127-4787-841b-83e5c47fcdeb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.055498 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.097465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbbe2-cbed-4165-bed2-d7459b254053 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.110615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e317f1-6127-4787-841b-83e5c47fcdeb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.124657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.135080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a671d-dbd5-44a3-ad29-16226078d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.135763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a671d-dbd5-44a3-ad29-16226078d288 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.136043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a671d-dbd5-44a3-ad29-16226078d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.136322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a671d-dbd5-44a3-ad29-16226078d288 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.137051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a671d-dbd5-44a3-ad29-16226078d288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:13.137375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a671d-dbd5-44a3-ad29-16226078d288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.138768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a671d-dbd5-44a3-ad29-16226078d288 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.149217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.149911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.150196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.150472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.151252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 425/837] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:13.152449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0237-0d50-439f-8e11-de7f01cb58fe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.152749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0237-0d50-439f-8e11-de7f01cb58fe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.153029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0237-0d50-439f-8e11-de7f01cb58fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.153610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:13.154138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.156084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.169916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b4cb0237-0d50-439f-8e11-de7f01cb58fe None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:13.170558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 413/838] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:13.171186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b4cb0237-0d50-439f-8e11-de7f01cb58fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:13.175061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.244756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 426/839] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:13.245642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0237-0d50-439f-8e11-de7f01cb58fe None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.299069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fbfb1-a197-42e6-b6c0-7b5d92dafa76 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.308042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.340167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.340960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.341238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.341535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.350154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.351594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.354669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0237-0d50-439f-8e11-de7f01cb58fe None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:13.365764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:13.366919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:13.368019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 414/840] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:13.369091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.403774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.404686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.405121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.405450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.406293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=85186f8437164bbbb99e007b5c85bd54) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:13.406605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.406975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.408366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.421382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 427/841] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/role_assignments?user.id=85186f8437164bbbb99e007b5c85bd54&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:13.421382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.519096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc1b7a-5a43-436b-a231-7bc7355dae22 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.555830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02980c26-3b21-4c11-b305-cdcdb547cc49 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.571617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.573701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.574214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.574924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.576456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.578090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.585446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:13.595923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:13.596937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:13.597819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:13.598555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.598555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.598700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.599528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.599643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 415/842] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:13.600027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:13.600332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.606271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.608802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.629471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 428/843] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:13.633996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.718110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.723961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248bfbe-e1d8-4ee2-b8ed-ebb609ca4aa2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.745791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ea7fc-cd8a-41e7-96c5-7edf52f2d486 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.763549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e04608-77fe-47c5-8c9e-7e8e6a57e2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.764217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e04608-77fe-47c5-8c9e-7e8e6a57e2fb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.764502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e04608-77fe-47c5-8c9e-7e8e6a57e2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.764779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e04608-77fe-47c5-8c9e-7e8e6a57e2fb None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.765518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e04608-77fe-47c5-8c9e-7e8e6a57e2fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:13.766130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e04608-77fe-47c5-8c9e-7e8e6a57e2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.767190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e04608-77fe-47c5-8c9e-7e8e6a57e2fb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.772977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 416/844] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:13.774088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a7db-630d-49e3-ba20-527602fbae19 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.774381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a7db-630d-49e3-ba20-527602fbae19 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.774663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476a7db-630d-49e3-ba20-527602fbae19 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.776035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 417/845] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:13.780576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a7db-630d-49e3-ba20-527602fbae19 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:13.790082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.790747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.791031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.791313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.846621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.867193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.868653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.893131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476a7db-630d-49e3-ba20-527602fbae19 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:13.930820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ed389-d3f0-4212-b6b6-5ba2e8079923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:13.931559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed389-d3f0-4212-b6b6-5ba2e8079923 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.931836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed389-d3f0-4212-b6b6-5ba2e8079923 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.932110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed389-d3f0-4212-b6b6-5ba2e8079923 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ed389-d3f0-4212-b6b6-5ba2e8079923 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:13.933111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ed389-d3f0-4212-b6b6-5ba2e8079923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:13.934735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ed389-d3f0-4212-b6b6-5ba2e8079923 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:13.939951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 418/846] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:13.941160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347270b-4455-4d86-94d5-a54912f0103d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:13.941477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347270b-4455-4d86-94d5-a54912f0103d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:13.941756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347270b-4455-4d86-94d5-a54912f0103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:13.961308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a347270b-4455-4d86-94d5-a54912f0103d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:13.962839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a347270b-4455-4d86-94d5-a54912f0103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:13.985180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:13.993462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 429/847] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:13.998999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.049393 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 419/848] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:14.077926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347270b-4455-4d86-94d5-a54912f0103d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.126257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:14.150393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbb29-f14e-49c4-9dd9-2ba6929292f6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.198504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.199541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.199916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.200311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.210362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347270b-4455-4d86-94d5-a54912f0103d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.214370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:14.215247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:14.234717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:14.235831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:14.236956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:14.236956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:14.236956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:14.236956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:14.238675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 430/849] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:14.244387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.256410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.257421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.257702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.257972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.269528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:14.278434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:14.279362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:55:14.280210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:14.282946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 420/850] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:14.291221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.313723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:14.376147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43247-eaa4-4ad2-be24-8c2ea9e11b33 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.404155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff03075-fd8d-461c-b804-a3743440474b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.412718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.413615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.414284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.414284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.415217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:14.415647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:14.417124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:14.418969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:14.437523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 431/851] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:14.438005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.451728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.452756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.453243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.453880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.454909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:14.455421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:14.457064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:14.477299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 421/852] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:14.478549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.561394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484864a-dd96-40fd-b8a7-09a4446eedd9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.581485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:14.601548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.602353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.602725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.602923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.610377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:14.611834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:14.612287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb058bbe-dc4d-4ea0-902b-3881849b7c67 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:14.626742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:14.627644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:14.628517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 432/853] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:14.634026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.659019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.659835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.660196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.660447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.672911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:14.674684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:14.694945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:14.695909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:14.696791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:14.696791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:14.696791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:14.696791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:14.701130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 422/854] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:14.702142 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.712259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:14.765835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da830f-11cd-4d7c-92eb-df051ab211c2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.802586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.803740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.804120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.804407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.805200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:14.805533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:14.807112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:14.820297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9803504-a06d-48b0-9bc5-2139e469a508 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.820889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 433/855] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:14.826715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.848984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:14.860605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.861518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.861951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.862433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:14.863344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:14.863858 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:14.865629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:14.879360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 423/856] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:14.885387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:14.953129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dd0fe-6be2-4da8-b005-22683ed62af0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:14.971770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:14.998574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:14.999253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:14.999537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:14.999812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:15.000657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=38d55235b0374bfa8ea73ac3f4e2836b) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:15.000968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:15.002472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:15.010347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 434/857] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/role_assignments?user.id=38d55235b0374bfa8ea73ac3f4e2836b&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:15.151414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a97b54-e925-4daa-a8bc-b638aaccc1b2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:15.191437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:15.192258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:15.192539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:15.192813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:15.201724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:15.203171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:15.218978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:15.219933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:15.221304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 424/858] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:55:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:15.226523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:15.337990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59fe5b-88e1-4b7c-a84e-f704a4364d34 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:15.374564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132142a-6abd-4590-8c9d-e412faf9f97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:15.375527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132142a-6abd-4590-8c9d-e412faf9f97c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:15.375989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132142a-6abd-4590-8c9d-e412faf9f97c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:15.376442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132142a-6abd-4590-8c9d-e412faf9f97c None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:15.377514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132142a-6abd-4590-8c9d-e412faf9f97c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:15.377999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132142a-6abd-4590-8c9d-e412faf9f97c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:15.379585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132142a-6abd-4590-8c9d-e412faf9f97c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:15.399636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 435/859] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 13:55:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:15.405475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:15.463874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:15.520685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365c9d2-edc2-41a8-873f-b0c61d28de18 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:15.558779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:15.559738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:15.560222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:15.560697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:15.586052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81dbb-8e32-4b58-bdd2-98cebdeca37e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:15.587014 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81dbb-8e32-4b58-bdd2-98cebdeca37e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:15.587492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81dbb-8e32-4b58-bdd2-98cebdeca37e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:15.589965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 436/860] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:15.595287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4fd3-4ee3-408d-ab72-9ebffd2accda None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:15.595569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4fd3-4ee3-408d-ab72-9ebffd2accda None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:15.595842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c4fd3-4ee3-408d-ab72-9ebffd2accda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:15.613313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-709c4fd3-4ee3-408d-ab72-9ebffd2accda None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:15.614516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-709c4fd3-4ee3-408d-ab72-9ebffd2accda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:15.647764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:15.657824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:15.659537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:15.693787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 437/861] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:15.714153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4fd3-4ee3-408d-ab72-9ebffd2accda None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:15.720657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:15.785394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 425/862] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:15.791733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:15.836265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c4fd3-4ee3-408d-ab72-9ebffd2accda None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:15.874486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:15.875888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:15.876703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:15.877591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:15.878710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:15.880606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:15.897560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:15.898488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:15.899297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:15.907368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 438/863] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Jul 18 13:55:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:15.908579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:15.931844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a3309-92e5-413d-b0a5-c0173764645a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:15.951446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:15.982710 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:15.984483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:15.985311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:15.985811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.001385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.003948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.016047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:16.034113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:16.035127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:16.036008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:16.036008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:16.036008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:16.036008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:16.039448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 426/864] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:16.045486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:16.047873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c397e1-f3fd-4fb6-98af-04f1093a8e5b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:16.095333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79274bdc-529e-469d-a720-ab9df362ec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:16.096470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274bdc-529e-469d-a720-ab9df362ec33 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.096754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274bdc-529e-469d-a720-ab9df362ec33 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.097149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79274bdc-529e-469d-a720-ab9df362ec33 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.097942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79274bdc-529e-469d-a720-ab9df362ec33 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:16.098255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79274bdc-529e-469d-a720-ab9df362ec33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.099770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79274bdc-529e-469d-a720-ab9df362ec33 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.105672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 439/865] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:16.107356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde5aa-c9b8-4a15-a198-3cce4b5c262d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.107708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde5aa-c9b8-4a15-a198-3cce4b5c262d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.108052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fde5aa-c9b8-4a15-a198-3cce4b5c262d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.109509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 440/866] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:16.111178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fde5aa-c9b8-4a15-a198-3cce4b5c262d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:16.179798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b3d92-a937-48f0-a278-cb52e321812c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:16.215484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571eee-5c77-442e-9068-610eef5e9a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:16.216174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571eee-5c77-442e-9068-610eef5e9a59 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.216457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571eee-5c77-442e-9068-610eef5e9a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.216733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571eee-5c77-442e-9068-610eef5e9a59 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.217509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571eee-5c77-442e-9068-610eef5e9a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:16.217823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571eee-5c77-442e-9068-610eef5e9a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.219370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571eee-5c77-442e-9068-610eef5e9a59 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.220826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:16.231731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fde5aa-c9b8-4a15-a198-3cce4b5c262d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:16.233499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 427/867] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:16.239161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973b09-b3b5-4fe6-ad1a-b7b4c9453f3c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.239452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973b09-b3b5-4fe6-ad1a-b7b4c9453f3c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.239772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13973b09-b3b5-4fe6-ad1a-b7b4c9453f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.257220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-13973b09-b3b5-4fe6-ad1a-b7b4c9453f3c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:16.258441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-13973b09-b3b5-4fe6-ad1a-b7b4c9453f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:16.270665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:16.271426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.271721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.272069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.272776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:16.273082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.274483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.287148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 441/868] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:16.287148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:16.333239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:16.354002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 428/869] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:16.370736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973b09-b3b5-4fe6-ad1a-b7b4c9453f3c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:16.409205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620297b-7357-4c30-8da7-d31a6eb00117 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:16.447750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:16.448468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.448744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.449013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.456893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.459020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:16.473213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:16.474421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:16.475332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 442/870] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:16.480323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:16.492395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13973b09-b3b5-4fe6-ad1a-b7b4c9453f3c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:16.502448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:16.542077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:16.542897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.543249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.543592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.544388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.545867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.566993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 429/871] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:16 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:16.620770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc794586-ea8b-4e86-ab9e-3f4b5c943a8f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:16.667420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d720e-387e-4122-b2b6-145de65e149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:16.668105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d720e-387e-4122-b2b6-145de65e149f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.668385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d720e-387e-4122-b2b6-145de65e149f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.668709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d720e-387e-4122-b2b6-145de65e149f None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.669562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d720e-387e-4122-b2b6-145de65e149f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:16.669878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d720e-387e-4122-b2b6-145de65e149f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.671336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d720e-387e-4122-b2b6-145de65e149f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.686896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 443/872] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:16.693197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:16.753650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:16.811223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f9450-ba49-480e-86f7-402192b4b6ac None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:16.847497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6096d8c-d05d-45d3-938a-b0a683618f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:16.848160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6096d8c-d05d-45d3-938a-b0a683618f1e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:16.848440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6096d8c-d05d-45d3-938a-b0a683618f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:16.848715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6096d8c-d05d-45d3-938a-b0a683618f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:16.850149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6096d8c-d05d-45d3-938a-b0a683618f1e None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=00828d68497c433d80fa2155b21adff4) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:16.850621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6096d8c-d05d-45d3-938a-b0a683618f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:16.852046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6096d8c-d05d-45d3-938a-b0a683618f1e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:16.858692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 430/873] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:16 2022] GET /identity/v3/role_assignments?user.id=00828d68497c433d80fa2155b21adff4&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:17.163057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a406d8-40dd-49bd-80ec-ad5336757e8d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:17.163384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a406d8-40dd-49bd-80ec-ad5336757e8d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:17.163622 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a406d8-40dd-49bd-80ec-ad5336757e8d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:17.165247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 444/874] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:17.170826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322d501-c41e-4229-b032-ff22f2c9f488 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:17.171123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322d501-c41e-4229-b032-ff22f2c9f488 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:17.171411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322d501-c41e-4229-b032-ff22f2c9f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:17.189232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3322d501-c41e-4229-b032-ff22f2c9f488 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:17.190451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3322d501-c41e-4229-b032-ff22f2c9f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:17.265483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 431/875] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:17.283704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a406d8-40dd-49bd-80ec-ad5336757e8d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:17.381859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:17.391924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a406d8-40dd-49bd-80ec-ad5336757e8d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:17.428652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:17.429488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:17.429773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:17.430046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:17.430700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:17.432128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:17.448226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:17.449240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:17.450962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 445/876] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:17.456205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322d501-c41e-4229-b032-ff22f2c9f488 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:17.505738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:17.563743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322d501-c41e-4229-b032-ff22f2c9f488 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:17.603632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0eaa4-a66d-42ef-969d-0e4ca110494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:17.604305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0eaa4-a66d-42ef-969d-0e4ca110494a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:17.604590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0eaa4-a66d-42ef-969d-0e4ca110494a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:17.604871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0eaa4-a66d-42ef-969d-0e4ca110494a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:17.605621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0eaa4-a66d-42ef-969d-0e4ca110494a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:17.605930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0eaa4-a66d-42ef-969d-0e4ca110494a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:17.607296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0eaa4-a66d-42ef-969d-0e4ca110494a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:17.617057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 432/877] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:17.622439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:17.728394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a3626-135b-4ab3-ac20-5bb510fb6560 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:17.763217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adffb0-1e23-4c8e-8a15-7e57acb1c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:17.763881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adffb0-1e23-4c8e-8a15-7e57acb1c2de None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:17.764162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adffb0-1e23-4c8e-8a15-7e57acb1c2de None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:17.764439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adffb0-1e23-4c8e-8a15-7e57acb1c2de None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:17.765146 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adffb0-1e23-4c8e-8a15-7e57acb1c2de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:17.765481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adffb0-1e23-4c8e-8a15-7e57acb1c2de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:17.766864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adffb0-1e23-4c8e-8a15-7e57acb1c2de None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:17.777493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 446/878] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:18.491760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34bcd-91ac-460a-832f-0d25814b1741 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:18.492516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34bcd-91ac-460a-832f-0d25814b1741 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:18.493014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b34bcd-91ac-460a-832f-0d25814b1741 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:18.494950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 433/879] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:18.500332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b17fa-51f8-4c28-b6aa-c2e46f771401 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:18.500867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b17fa-51f8-4c28-b6aa-c2e46f771401 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:18.501377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b17fa-51f8-4c28-b6aa-c2e46f771401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:18.507440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:18.520150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a35b17fa-51f8-4c28-b6aa-c2e46f771401 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:18.521818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a35b17fa-51f8-4c28-b6aa-c2e46f771401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:18.592238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 447/880] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:18.615123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b34bcd-91ac-460a-832f-0d25814b1741 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:18.724835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1429b0-5ef3-4849-8450-ea4ccdfc7862 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:18.725391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1429b0-5ef3-4849-8450-ea4ccdfc7862 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:18.725391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1429b0-5ef3-4849-8450-ea4ccdfc7862 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:18.727231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 448/881] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:18.728782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b34bcd-91ac-460a-832f-0d25814b1741 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:18.732231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3fe5-913e-4f2c-84bc-17db239c92b2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:18.732522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3fe5-913e-4f2c-84bc-17db239c92b2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:18.732803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3fe5-913e-4f2c-84bc-17db239c92b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:18.739417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:18.751651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4fff3fe5-913e-4f2c-84bc-17db239c92b2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:18.752879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4fff3fe5-913e-4f2c-84bc-17db239c92b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:18.775334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:18.776531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:18.776993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:18.777599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:18.778832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:18.780765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:18.799405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 434/882] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:18 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:18.849813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 449/883] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:18.870157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:18.995648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88f80f-fc16-4da2-913e-d6e573023581 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.030062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e54b9-e41a-4ab8-b65e-7ee1f07f40f0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.030428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e54b9-e41a-4ab8-b65e-7ee1f07f40f0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.030707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e54b9-e41a-4ab8-b65e-7ee1f07f40f0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.032170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 450/884] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:19.032774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.033773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.034209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.034753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.035557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.037284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.037751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfacfa-591a-47ff-b681-4b697c376ff1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.038032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfacfa-591a-47ff-b681-4b697c376ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.038320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfacfa-591a-47ff-b681-4b697c376ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:19.051843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:19.053470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:19.054548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:19.055474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 435/885] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:19.060732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.068237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f1dfacfa-591a-47ff-b681-4b697c376ff1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:19.069716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f1dfacfa-591a-47ff-b681-4b697c376ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:19.103024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:19.144168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:19.165457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 451/886] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:19.182596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e2d01-e9ac-4f6c-9026-9f546a70a7a8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.183983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfacfa-591a-47ff-b681-4b697c376ff1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.223993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.224666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.224949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.225227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.226029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:19.226335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.227888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.233531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 436/887] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:19.240940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.297127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfacfa-591a-47ff-b681-4b697c376ff1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.334788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.335608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.335889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.336163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.345868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ca04b-7187-4086-a847-e2808dbd4ba3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.347186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:19.353768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:19.355637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:19.356616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:19.357470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:19.361851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 452/888] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:19.363134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.394637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.396425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.397012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.397298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.398381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:19.398747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.400881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.407760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 437/889] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:19.413611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.421607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:19.489454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a483d-e440-4080-8ad9-176aadf3a144 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.524724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6c548-5e71-4756-8ad9-1da5c091bf5c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.532293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.533458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.533805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.534088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.535331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:19.535652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.537536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.548932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 453/890] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:19.555815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.570902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.572126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.572626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.573112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.574203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] RBAC: Adding query filter params (interface=public, service_id=5ba80fdafe634904b13d23803d7d5d39, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:19.574837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.576861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.587865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 438/891] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/endpoints?service_id=5ba80fdafe634904b13d23803d7d5d39&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:19.589590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.620673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:19.683908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e3a6b-c6c1-44c6-836b-eebae2745bed None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.696307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:19.720764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d72fe-e0d1-4d53-bff1-62a437b7012e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.723123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.724226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.724815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.725313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.737736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.740306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:19.759194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:19.760165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:19.761036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:19.761036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:19.761036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:19.761036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:19.762620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a5741-e2c6-4b61-8e2c-396a3e62cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.763291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5741-e2c6-4b61-8e2c-396a3e62cc92 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.763580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5741-e2c6-4b61-8e2c-396a3e62cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.764876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a5741-e2c6-4b61-8e2c-396a3e62cc92 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.764876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a5741-e2c6-4b61-8e2c-396a3e62cc92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.768850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a5741-e2c6-4b61-8e2c-396a3e62cc92 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.769097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 454/892] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:19.770501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.777378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 439/893] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 13:55:19.862657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9df09-932c-4f98-985b-b0f281f2e626 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.862840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9df09-932c-4f98-985b-b0f281f2e626 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.863113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9df09-932c-4f98-985b-b0f281f2e626 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.864854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 440/894] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:19.870330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b27d-0723-44f1-8034-bbf360773d43 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.870630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b27d-0723-44f1-8034-bbf360773d43 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.870882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015b27d-0723-44f1-8034-bbf360773d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.889617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c015b27d-0723-44f1-8034-bbf360773d43 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:19.890831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c015b27d-0723-44f1-8034-bbf360773d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:19.892392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed372f-68f4-40fa-b5a6-a0e8e478839e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:19.943953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:19.944638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:19.945303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:19.947364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:19.948695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:19.949500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:19.952263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:19.970236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 455/895] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:19.976766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:19.979993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 441/896] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:20.003790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b27d-0723-44f1-8034-bbf360773d43 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:20.010330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:20.029722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:20.122830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1d48e-84a6-4505-b5df-edc60bc61120 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:20.124796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015b27d-0723-44f1-8034-bbf360773d43 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:20.172219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:20.172975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:20.173324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:20.173726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:20.174051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:20.174587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:20.175263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:20.175720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:20.176132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:20.176367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:20.185219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:20.186691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:20.196396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 442/897] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:20 2022] POST /identity/v3/services => generated 241 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:20.203803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:20.204830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:20.205848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 456/898] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:55:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:20.214055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:20.310127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:20.344551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8b08-dc55-43a2-b3a1-0887d217da8c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:20.380495 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:20.381181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:20.381490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:20.381762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:20.382592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:20.382893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:20.384368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:20.403883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 443/899] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 13:55:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:20.409518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:20.498824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:20.517686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19aa00-f2a9-402d-8142-c31a78c1c199 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:20.554266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:20.555373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:20.555869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:20.556341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:20.630856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:20.632633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:20.716075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:20.750825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 457/900] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:20 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:20.752295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:20.860957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e187e2-ba47-4c90-b30c-14c5e209a0de None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:20.893541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:20.899741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655269f-3316-4a2d-bb2e-919f0823f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:20.900758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655269f-3316-4a2d-bb2e-919f0823f731 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:20.901226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655269f-3316-4a2d-bb2e-919f0823f731 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:20.901535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655269f-3316-4a2d-bb2e-919f0823f731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:20.912780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655269f-3316-4a2d-bb2e-919f0823f731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:20.914272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655269f-3316-4a2d-bb2e-919f0823f731 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-7655269f-3316-4a2d-bb2e-919f0823f731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:20.932810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:20.933748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:20.934619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:20.934619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:20.934619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:20.934619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:20.937605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 444/901] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:20.940391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.006602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db90f-90c7-4bcf-97d6-1cf2e24082e2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.006943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db90f-90c7-4bcf-97d6-1cf2e24082e2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.007516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db90f-90c7-4bcf-97d6-1cf2e24082e2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.009621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 445/902] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:21.015025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4acf-3120-4258-abb1-34061197f217 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.015311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4acf-3120-4258-abb1-34061197f217 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.015589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4acf-3120-4258-abb1-34061197f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.039556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8b9f4acf-3120-4258-abb1-34061197f217 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:21.041908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8b9f4acf-3120-4258-abb1-34061197f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:21.063787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598334a-0e78-4de2-b5e5-164d9e7d66e6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.106493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.107530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.108122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.108600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.109564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:21.110065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.111751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.125144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 446/903] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:21.135315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 458/904] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:21.136918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4acf-3120-4258-abb1-34061197f217 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.142951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.189191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:21.250469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4acf-3120-4258-abb1-34061197f217 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.256795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6da71-5224-414d-b81e-26debbcfe589 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.268111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:21.295205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.295621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.296260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.296653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.296921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.297109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.297534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.297950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.298071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.299526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.306165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.307866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:21.313436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:21.314584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:21.315650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:21.318491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 459/905] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:21.323980 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:21.326772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:21.327830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:21.328927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:21.331784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 447/906] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:21.337044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.455591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee743b-4118-49cb-9a56-3e5b3381270b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.456797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9bfcd-032d-47de-b158-996525ebc251 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.465747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:21.495823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.496837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.497386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.497894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.498902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:21.499251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.499673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.499916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.500195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.500472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.501168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:21.501491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.502452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.502845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.514104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 460/907] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:21.515442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.525111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 448/908] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:21.526834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.567089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:21.637647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345160ac-0d6b-48f2-a8c7-d1edd4e09eb3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.650784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5653d72-20e5-462e-ae7c-28bc068d4bc5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.674870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.675969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.676459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.677684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.678745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:21.679333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.681026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.687243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 461/909] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:21.692746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.697040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.698052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.698579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.699069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.700113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] RBAC: Adding query filter params (role.id=ba55c846780c48acb5c54cf50b8039f8, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=00828d68497c433d80fa2155b21adff4) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:21.700924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.702786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.715105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 449/910] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/role_assignments?user.id=00828d68497c433d80fa2155b21adff4&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=ba55c846780c48acb5c54cf50b8039f8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:21.731789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:21.808191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8183520-99bc-47d8-8bcd-583432b0e2b0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:21.846045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02275df1-ac50-4899-89b8-dc3cafed8c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:21.846710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275df1-ac50-4899-89b8-dc3cafed8c5e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.846989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275df1-ac50-4899-89b8-dc3cafed8c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.847259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02275df1-ac50-4899-89b8-dc3cafed8c5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.848060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02275df1-ac50-4899-89b8-dc3cafed8c5e None admin] RBAC: Adding query filter params (interface=public, service_id=6d8dbed5195d4e52a2ceefb12e399f6e, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:21.848366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02275df1-ac50-4899-89b8-dc3cafed8c5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:21.849890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02275df1-ac50-4899-89b8-dc3cafed8c5e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:21.856307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 462/911] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/endpoints?service_id=6d8dbed5195d4e52a2ceefb12e399f6e&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:21.861929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:21.914838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ee356-4d03-44f3-bb81-82debb635866 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.915167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ee356-4d03-44f3-bb81-82debb635866 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.915388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ee356-4d03-44f3-bb81-82debb635866 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.917406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 463/912] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:21.922692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7a60-11fb-4ea3-99cd-77454b41d85b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:21.922971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7a60-11fb-4ea3-99cd-77454b41d85b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:21.923242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc7a60-11fb-4ea3-99cd-77454b41d85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:21.941133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-64dc7a60-11fb-4ea3-99cd-77454b41d85b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:21.943384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-64dc7a60-11fb-4ea3-99cd-77454b41d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:21.999452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8f441-d312-4712-8f7c-c60a795d2fcb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.025563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:22.025930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 464/913] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:22.040777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.041477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.041756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.042029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.042715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:22.044133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:22.045690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc7a60-11fb-4ea3-99cd-77454b41d85b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:22.051410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 450/914] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:21 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 13:55:22.103874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:22.179516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc7a60-11fb-4ea3-99cd-77454b41d85b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.219533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11bcfa7-26e4-4718-b9b7-48fb129fdd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.220353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bcfa7-26e4-4718-b9b7-48fb129fdd69 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.220639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bcfa7-26e4-4718-b9b7-48fb129fdd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.220919 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11bcfa7-26e4-4718-b9b7-48fb129fdd69 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.221624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11bcfa7-26e4-4718-b9b7-48fb129fdd69 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:22.223019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11bcfa7-26e4-4718-b9b7-48fb129fdd69 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b11bcfa7-26e4-4718-b9b7-48fb129fdd69 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:22.236512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:22.237570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:22.238410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 465/915] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:22.246194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:22.321110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f6507-7e41-48a5-a636-2695715845f3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.321464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f6507-7e41-48a5-a636-2695715845f3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.321708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f6507-7e41-48a5-a636-2695715845f3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.323457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 466/916] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:22.328611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be38b40-1942-4afb-bd48-7e5bf38d8a85 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.328891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be38b40-1942-4afb-bd48-7e5bf38d8a85 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.329171 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be38b40-1942-4afb-bd48-7e5bf38d8a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.348561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5be38b40-1942-4afb-bd48-7e5bf38d8a85 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:22.350463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5be38b40-1942-4afb-bd48-7e5bf38d8a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:22.373240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b653e-836d-4474-b9a3-debef1089173 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.422593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.423690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.424212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.424690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.425450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 467/917] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:22.425866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:22.426375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:22.428918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:22.434988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 451/918] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:22.441088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be38b40-1942-4afb-bd48-7e5bf38d8a85 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:22.447129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:22.472410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:22.484128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:22.565968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15cc6f-c74a-4dd5-928d-1591bc1b5a84 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.584617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be38b40-1942-4afb-bd48-7e5bf38d8a85 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.609093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.609780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.610066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.610341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.610994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:22.612468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:22.626542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:22.627573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:22.628389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:22.632849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 452/919] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:22.633592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.633812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:22.635030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.635745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.636765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.637724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:22.639211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:22.640794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:22.653062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 468/920] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 13:55:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:22.654942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:22.751271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:22.756918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:22.764931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59995869-21c7-4e9a-bf70-b3d658a0defc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.776443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42416c72-e61b-40ec-adad-63e18d8ab994 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.810276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.810955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.811240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.811517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.812618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:22.812618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:22.814038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:22.825108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 453/921] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:22.826394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:22.830993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.832242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:22.832731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:22.833852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:22.835293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:22.837561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:22.865812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 469/922] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:22.953115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919a284-ad3d-47f3-9611-cda75485aca2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:22.998650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:22.999711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:23.000216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:23.000689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:23.001633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:23.002147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:23.003839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:23.011068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 454/923] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:23.016595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:23.131456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1916cc7-f16b-433f-a352-0f000514cb1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:23.169697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23020e36-6c0c-4fae-bfbc-0e4f3af33a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:23.170367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23020e36-6c0c-4fae-bfbc-0e4f3af33a10 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:23.170652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23020e36-6c0c-4fae-bfbc-0e4f3af33a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:23.170932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23020e36-6c0c-4fae-bfbc-0e4f3af33a10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:23.171729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23020e36-6c0c-4fae-bfbc-0e4f3af33a10 None admin] RBAC: Adding query filter params (interface=public, service_id=63d1bf6c13d740ddb0e288989b7b25eb, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:23.172043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23020e36-6c0c-4fae-bfbc-0e4f3af33a10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:23.173518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23020e36-6c0c-4fae-bfbc-0e4f3af33a10 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:23.180205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 470/924] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:55:23 2022] GET /identity/v3/endpoints?service_id=63d1bf6c13d740ddb0e288989b7b25eb&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:23.185852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:23.205221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:23.306157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bf679-8438-42ac-8fda-239e99d28871 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:23.344241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e975ff0-b49e-45e0-8f3b-6b08755bc1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:23.345261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e975ff0-b49e-45e0-8f3b-6b08755bc1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:23.345800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e975ff0-b49e-45e0-8f3b-6b08755bc1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:23.346294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e975ff0-b49e-45e0-8f3b-6b08755bc1d4 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:23.347178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e975ff0-b49e-45e0-8f3b-6b08755bc1d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:23.348957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e975ff0-b49e-45e0-8f3b-6b08755bc1d4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:23.355809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 455/925] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:23 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 13:55:23.777973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6857f-0020-4baa-a328-4cf8e0469776 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:23.778339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6857f-0020-4baa-a328-4cf8e0469776 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:23.778540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6857f-0020-4baa-a328-4cf8e0469776 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:23.780106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 471/926] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:23.785411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c139408-9470-4e04-87d6-6793ec27237a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:23.785706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c139408-9470-4e04-87d6-6793ec27237a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:23.785997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c139408-9470-4e04-87d6-6793ec27237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:23.804078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9c139408-9470-4e04-87d6-6793ec27237a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:23.805258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c139408-9470-4e04-87d6-6793ec27237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:23.876766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 456/927] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:23.899893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6857f-0020-4baa-a328-4cf8e0469776 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:23.909284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.008367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6857f-0020-4baa-a328-4cf8e0469776 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.045020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.045797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.046083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.046360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.057090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:24.065304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:24.066484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:24.067464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 472/928] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 13:55:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:24.072800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c139408-9470-4e04-87d6-6793ec27237a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.088849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.192049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c139408-9470-4e04-87d6-6793ec27237a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.228678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c47e-e0d6-44cd-9f0f-25ea0100f9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.229372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c47e-e0d6-44cd-9f0f-25ea0100f9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.229652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c47e-e0d6-44cd-9f0f-25ea0100f9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.229924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c47e-e0d6-44cd-9f0f-25ea0100f9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.230664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c47e-e0d6-44cd-9f0f-25ea0100f9f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:24.230966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c47e-e0d6-44cd-9f0f-25ea0100f9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:24.232319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c47e-e0d6-44cd-9f0f-25ea0100f9f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:24.240991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 457/929] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:24.246560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.257231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03444d-082c-4d48-a51c-a9519b0908c4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.257901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03444d-082c-4d48-a51c-a9519b0908c4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.258860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03444d-082c-4d48-a51c-a9519b0908c4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.261695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 458/930] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:24.266709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2576cd-0bea-4f6e-9bdc-c5462dec39d1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.267049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2576cd-0bea-4f6e-9bdc-c5462dec39d1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.267385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2576cd-0bea-4f6e-9bdc-c5462dec39d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.286872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5f2576cd-0bea-4f6e-9bdc-c5462dec39d1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:24.288666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5f2576cd-0bea-4f6e-9bdc-c5462dec39d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:24.330334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.360837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.371787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 459/931] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:24.375979 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6f92f-fc4f-4d0a-8e13-762ab368f157 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.390966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2576cd-0bea-4f6e-9bdc-c5462dec39d1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.417252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.419011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.419631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.420175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.435231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:24.436206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:24.456117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:24.457163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:24.458198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:24.458198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:24.458198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:24.458198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:24.462947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 473/932] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:24.463948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.519438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2576cd-0bea-4f6e-9bdc-c5462dec39d1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.557177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.558353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.558824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.559277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.560099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:24.561673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:24.574750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:24.575955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 13:55:24.576771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:24.579897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 460/933] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:24.587089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.594815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93738f32-e14e-4a99-af72-312c7a91088a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.619423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.643299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.643961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.644238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.644506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.647030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:24.647358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:24.648766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:24.666081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 474/934] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:24.666991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.673247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.717545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83008-d09b-4176-afa2-bfc035fd89b5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.756936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.757974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.758453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.758918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.760029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:24.760528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:24.762234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:24.769309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 461/935] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:24.775583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.777757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699c1af-4878-43fc-ba6a-2efc6dbc0539 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.821756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.823079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.823598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.824137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.834345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:24.836792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:24.854720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:24.855658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:24.856585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:24.863844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 475/936] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:24.865380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:24.886586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5ae5e-fdef-4140-badb-8d7f1935f269 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:24.917751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.920986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:24.928928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:24.929623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:24.929878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:24.930149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:24.930863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:24.931164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:24.932643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:24.944332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 462/937] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:24.945423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.002182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e0073-0779-4f62-9a20-b7d2999164b5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.041782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8909e-9c57-4453-a94c-437607341bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.042732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8909e-9c57-4453-a94c-437607341bdd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.043180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8909e-9c57-4453-a94c-437607341bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.043608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8909e-9c57-4453-a94c-437607341bdd None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.044702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8909e-9c57-4453-a94c-437607341bdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:25.045226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8909e-9c57-4453-a94c-437607341bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.046951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8909e-9c57-4453-a94c-437607341bdd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.057836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d0652-e92e-4ab3-b6b2-15c0d23c507a None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.071916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 476/938] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 13:55:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:25.071916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c344f2f-d269-420b-a774-99e145f97a02 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.071916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c344f2f-d269-420b-a774-99e145f97a02 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.071916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c344f2f-d269-420b-a774-99e145f97a02 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.073077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 477/939] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:25.078731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c344f2f-d269-420b-a774-99e145f97a02 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.101049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0d5fe-0709-4d11-bbab-9ef2c650ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.101896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d5fe-0709-4d11-bbab-9ef2c650ae12 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.102175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d5fe-0709-4d11-bbab-9ef2c650ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.102443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d5fe-0709-4d11-bbab-9ef2c650ae12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.103247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0d5fe-0709-4d11-bbab-9ef2c650ae12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.104619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0d5fe-0709-4d11-bbab-9ef2c650ae12 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.125673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 463/940] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:25.127484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abae35-ac73-48b8-bb45-277dd90d872c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.127837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abae35-ac73-48b8-bb45-277dd90d872c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.128187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abae35-ac73-48b8-bb45-277dd90d872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.147519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-11abae35-ac73-48b8-bb45-277dd90d872c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:25.148850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-11abae35-ac73-48b8-bb45-277dd90d872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:25.212875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:25.214022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:25.231878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c344f2f-d269-420b-a774-99e145f97a02 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.255696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 464/941] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:25.280052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abae35-ac73-48b8-bb45-277dd90d872c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.282749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.283827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.284325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.284797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.300060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.300807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:25.323480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:25.324424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:25.326192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:25.326192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:25.326192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:25.326192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:25.326192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 478/942] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:25.330511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.406020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abae35-ac73-48b8-bb45-277dd90d872c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.443024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.443563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.443842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.444112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.445287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.446818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.448244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING keystone.server.flask.common [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 13:55:25.451421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3b78f-418b-4ecb-9096-2516901838a6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.467728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 13:55:25.467728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 13:55:25.467728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [parameters: {'id': 'c1365e5c57d741f78019ed64ab7cf420', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 13:55:25.467728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8d001198-3241-4e5f-9333-ee968cf47baf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1365e5c57d741f78019ed64ab7cf420.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1365e5c57d741f78019ed64ab7cf420. Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:55:25.475957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 13:55:25.476805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jul 18 13:55:25.477782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 13:55:25.478666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 13:55:25.479542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:55:25.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'id': 'c1365e5c57d741f78019ed64ab7cf420', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.481192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:25.487868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1365e5c57d741f78019ed64ab7cf420. Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 465/943] 10.222.0.76 () {60 vars in 1140 bytes} [Mon Jul 18 13:55:25 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c78ef-bcf5-4d45-bdb3-fbde31337772 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.489746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c78ef-bcf5-4d45-bdb3-fbde31337772 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.491070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c78ef-bcf5-4d45-bdb3-fbde31337772 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.491070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 466/944] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:25.491070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c78ef-bcf5-4d45-bdb3-fbde31337772 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.506176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65df613-714b-4053-83b5-180776a9e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.506846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df613-714b-4053-83b5-180776a9e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.507131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df613-714b-4053-83b5-180776a9e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.507445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df613-714b-4053-83b5-180776a9e3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.508131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df613-714b-4053-83b5-180776a9e3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:25.508434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df613-714b-4053-83b5-180776a9e3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.509975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df613-714b-4053-83b5-180776a9e3a8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.523073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 479/945] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:25.524293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aa5d2-fe87-4cef-ac83-a1f735b46f28 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.524586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aa5d2-fe87-4cef-ac83-a1f735b46f28 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.525097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aa5d2-fe87-4cef-ac83-a1f735b46f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.526625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:25.534883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:25.547843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-178aa5d2-fe87-4cef-ac83-a1f735b46f28 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:25.549033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-178aa5d2-fe87-4cef-ac83-a1f735b46f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:25.607945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c78ef-bcf5-4d45-bdb3-fbde31337772 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.622642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 480/946] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:25.623395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aa5d2-fe87-4cef-ac83-a1f735b46f28 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.656808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.658229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.658714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.659185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.668684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.671278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:25.690334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:25.691234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:25.692250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.698971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 467/947] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:25.698971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.736113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aa5d2-fe87-4cef-ac83-a1f735b46f28 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.772775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.773595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.773876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.774176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.776216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:25.782764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.784714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.794574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:25.801991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:25.802858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:25.803730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 481/948] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:25.804226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.805753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58406d-3619-4d2a-a95f-140ce06677e9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.843968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.844777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.845056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.845330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.846079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.847362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:25.860053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:25.861069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:25.862375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 468/949] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:25.863162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:25.918468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f687a5-4d93-4ac7-b0ac-acdb957a88ce None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.954937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:25.955715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:25.955983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:25.956260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:25.957007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:25.957310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:25.958843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:25.976902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691f706-45e6-46ba-8d72-ad9ef4e84bf6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:25.989660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 482/950] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:25.989660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:26.026779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:26.027642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:26.027991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:26.028345 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:26.029224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:26.029644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:26.031208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:26.053275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:26.053499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 469/951] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:26.055331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:26.077880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:26.131286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbe0bd-5881-40d9-baac-9b4b36974666 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:26.177297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:26.178208 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:26.178575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:26.178924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:26.179730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:26.180103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:26.181591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:26.188254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 483/952] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:26.196657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:26.197954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8884e32-6496-4da3-a3b3-4cb13f7c1e04 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:26.243620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:26.245650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:26.246059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:26.246384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/00828d68497c433d80fa2155b21adff4/roles/ba55c846780c48acb5c54cf50b8039f8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:26.248705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=00828d68497c433d80fa2155b21adff4, role_id=ba55c846780c48acb5c54cf50b8039f8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:26.250696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:26.267995 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 470/953] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:55:26 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/00828d68497c433d80fa2155b21adff4/roles/ba55c846780c48acb5c54cf50b8039f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:55:26.331491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aab80f-895b-41fe-8d2c-1f521d16e53a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:26.353119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:26.374699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c16e41-62de-40a7-a508-2df99476d2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:26.375735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16e41-62de-40a7-a508-2df99476d2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:26.376201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16e41-62de-40a7-a508-2df99476d2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:26.376656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16e41-62de-40a7-a508-2df99476d2a3 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:26.377607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c16e41-62de-40a7-a508-2df99476d2a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:26.378127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c16e41-62de-40a7-a508-2df99476d2a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:26.380465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c16e41-62de-40a7-a508-2df99476d2a3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:26.387263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 484/954] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:26.392860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:26.495046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:26.514650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7ec49-22a2-48e4-aa84-11f03cf76995 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:26.553075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4b4f5-bd32-424c-bb2d-b2d8a76d8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:26.553772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b4f5-bd32-424c-bb2d-b2d8a76d8c63 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:26.554057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b4f5-bd32-424c-bb2d-b2d8a76d8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:26.554336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4b4f5-bd32-424c-bb2d-b2d8a76d8c63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:26.555087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4b4f5-bd32-424c-bb2d-b2d8a76d8c63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:26.556571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4b4f5-bd32-424c-bb2d-b2d8a76d8c63 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:26.578182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 471/955] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:27.313213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304492-31bc-4b0e-bd1f-8b1c69b9cb81 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:27.313764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304492-31bc-4b0e-bd1f-8b1c69b9cb81 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:27.314051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7304492-31bc-4b0e-bd1f-8b1c69b9cb81 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:27.315581 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 485/956] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:27.322020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a60de-e107-406f-a0aa-5daaebbb4a08 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:27.323393 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a60de-e107-406f-a0aa-5daaebbb4a08 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:27.324157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a60de-e107-406f-a0aa-5daaebbb4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:27.343936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c41a60de-e107-406f-a0aa-5daaebbb4a08 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:27.345950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c41a60de-e107-406f-a0aa-5daaebbb4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:27.433461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 472/957] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:27.450446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304492-31bc-4b0e-bd1f-8b1c69b9cb81 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:27.560565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7304492-31bc-4b0e-bd1f-8b1c69b9cb81 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:27.596364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:27.597086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:27.597385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:27.597668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:27.598985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:27.600720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:27.612917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:27.614297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:27.615216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 486/958] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:27.621083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a60de-e107-406f-a0aa-5daaebbb4a08 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:27.707993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:27.728318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a60de-e107-406f-a0aa-5daaebbb4a08 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:27.765749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fed381-9fa3-4a3d-97aa-ec4322dfbe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:27.766444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed381-9fa3-4a3d-97aa-ec4322dfbe40 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:27.766729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed381-9fa3-4a3d-97aa-ec4322dfbe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:27.767011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fed381-9fa3-4a3d-97aa-ec4322dfbe40 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:27.767739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed381-9fa3-4a3d-97aa-ec4322dfbe40 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:27.768048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed381-9fa3-4a3d-97aa-ec4322dfbe40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:27.769486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fed381-9fa3-4a3d-97aa-ec4322dfbe40 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:27.779974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 473/959] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:27.781508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:27.835568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:27.897593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25486591-7bed-4308-8899-b63f3c11740f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:27.934088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e870b1-24e8-4f72-8075-14ea3d7323a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:27.934754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e870b1-24e8-4f72-8075-14ea3d7323a9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:27.935038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e870b1-24e8-4f72-8075-14ea3d7323a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:27.935313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e870b1-24e8-4f72-8075-14ea3d7323a9 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:27.936021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e870b1-24e8-4f72-8075-14ea3d7323a9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:27.936327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e870b1-24e8-4f72-8075-14ea3d7323a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:27.937719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e870b1-24e8-4f72-8075-14ea3d7323a9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:27.943095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 487/960] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:28.262239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aced18-af35-49fa-bb30-c34928e7fc85 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.262542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aced18-af35-49fa-bb30-c34928e7fc85 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.262702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aced18-af35-49fa-bb30-c34928e7fc85 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.267132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 474/961] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:28.273139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d7b2-17aa-43cd-80c6-392feb51f91e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.273471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d7b2-17aa-43cd-80c6-392feb51f91e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.273759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d7b2-17aa-43cd-80c6-392feb51f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.291881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f2f6d7b2-17aa-43cd-80c6-392feb51f91e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:28.293087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f2f6d7b2-17aa-43cd-80c6-392feb51f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:28.372089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 488/962] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:28.387397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da2dbb-979a-4edd-8391-7ac55d34f01d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.388008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da2dbb-979a-4edd-8391-7ac55d34f01d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.388008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da2dbb-979a-4edd-8391-7ac55d34f01d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.389576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 475/963] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:28.394758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502c5f-1b9c-4b9b-bd09-a0cd9538066a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.395567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502c5f-1b9c-4b9b-bd09-a0cd9538066a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.395891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5502c5f-1b9c-4b9b-bd09-a0cd9538066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.397594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da2dbb-979a-4edd-8391-7ac55d34f01d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:28.415058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a5502c5f-1b9c-4b9b-bd09-a0cd9538066a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:28.416251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a5502c5f-1b9c-4b9b-bd09-a0cd9538066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:28.473716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.500542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 489/964] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:28.516198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da2dbb-979a-4edd-8391-7ac55d34f01d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:28.523592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502c5f-1b9c-4b9b-bd09-a0cd9538066a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:28.542288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.553886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:28.554789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.555223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.555649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.556514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:28.558132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:28.572928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.sql.core [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 13:55:28.572928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 13:55:28.572928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [parameters: {'user_id': '85b9b33b7fee4d95a6699ac1741205cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 13:55:28.572928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80135) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 18 13:55:28.584516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 13:55:28.585634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application yield resource Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application next(self.gen) Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise self.value Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application session.commit() Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 13:55:28.586812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.session.flush() Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application compat.raise_( Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 13:55:28.587897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 13:55:28.589191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application conn.query(q) Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application result.read() Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 13:55:28.590227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [parameters: {'user_id': '85b9b33b7fee4d95a6699ac1741205cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:28.591484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 13:55:28.592551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 13:55:28.593705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 13:55:28.593705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 13:55:28.593705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 13:55:28.593705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 13:55:28.593705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 13:55:28.593705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:28.596682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 476/965] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 13:55:28 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:28.602559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:28.639619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5502c5f-1b9c-4b9b-bd09-a0cd9538066a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:28.685657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:28.687130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.687801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.688232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.703670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:28.716170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:28.717436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:28.718464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:28.721330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 490/966] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 13:55:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:28.728102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:28.739426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd5a3c-51de-47ea-8acb-664ac39a73d2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:28.759185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.775240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4866a5c-ee38-4f3b-afcc-45b689c42c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:28.776038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4866a5c-ee38-4f3b-afcc-45b689c42c12 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.776323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4866a5c-ee38-4f3b-afcc-45b689c42c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.776599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4866a5c-ee38-4f3b-afcc-45b689c42c12 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.784300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4866a5c-ee38-4f3b-afcc-45b689c42c12 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:28.786570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4866a5c-ee38-4f3b-afcc-45b689c42c12 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f4866a5c-ee38-4f3b-afcc-45b689c42c12 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:28.800922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:28.802202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:28.803235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 477/967] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:28.803836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8884db-08bf-4805-9c52-4430cc5842a0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.803836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8884db-08bf-4805-9c52-4430cc5842a0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.804053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8884db-08bf-4805-9c52-4430cc5842a0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.808214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 478/968] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:28.808925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8884db-08bf-4805-9c52-4430cc5842a0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:28.845597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36701454-0240-47eb-8e9b-4717cf97d2aa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:28.857517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:28.886477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70cbbd-cfa8-4cdb-8a4a-d11bbf88d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:28.887147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70cbbd-cfa8-4cdb-8a4a-d11bbf88d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.887432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70cbbd-cfa8-4cdb-8a4a-d11bbf88d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.887714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70cbbd-cfa8-4cdb-8a4a-d11bbf88d8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.888464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70cbbd-cfa8-4cdb-8a4a-d11bbf88d8b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:28.888772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70cbbd-cfa8-4cdb-8a4a-d11bbf88d8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:28.890585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70cbbd-cfa8-4cdb-8a4a-d11bbf88d8b7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:28.903944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 491/969] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 13:55:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:28.903944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ddcdf-5269-4bbb-bbab-5374b0916c61 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.903944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ddcdf-5269-4bbb-bbab-5374b0916c61 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.903944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ddcdf-5269-4bbb-bbab-5374b0916c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.920051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-692ddcdf-5269-4bbb-bbab-5374b0916c61 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:28.921254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-692ddcdf-5269-4bbb-bbab-5374b0916c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:28.922305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8884db-08bf-4805-9c52-4430cc5842a0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:28.958971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:28.959644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:28.959925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:28.960199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:28.960999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:28.962050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:28.962753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:28.995951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 492/970] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:28.996795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ddcdf-5269-4bbb-bbab-5374b0916c61 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.002209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 479/971] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 13:55:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:29.022237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.035258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:29.135710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ddcdf-5269-4bbb-bbab-5374b0916c61 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.162657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3de1d-680c-41a2-b310-3e0e0f5ea655 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.166056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:29.183050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.183757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.184037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.184309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.197223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.198840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.210587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.211742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.212227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.212715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.213642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.215282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:29.218182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:29.219750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:29.220666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:29.220666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:29.220666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:29.220666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:29.220666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 493/972] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:29.226656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:29.236156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:29.237404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:29.238468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:29.242036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 480/973] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:29.250355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.306455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:29.336106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179d49-30a3-44ab-9a4d-9a886f8fccbc None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.359061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255292c-70f2-456f-9230-782a2bfa4067 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.374070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.375006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.375290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.375567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.376444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:29.377099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.378518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.390311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 494/974] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:29.396163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.405094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.405876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.406234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.406929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.407656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:29.407969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.410459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.418001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 481/975] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:29.423532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.456953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:29.511364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582f4b-098e-4a79-865f-0e53670a9cf6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.536470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971395-ecf4-49fe-8a21-d21ffedd7f6b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.546865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.547679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.547964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.548246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.550496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:29.558440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.560087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.573248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.573971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.574251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.574521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.575480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:29.575781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:29.576429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:29.577535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 13:55:29.578720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:29.579451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.579523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 495/976] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:29.588763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 482/977] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:29.588920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.589632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.689163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:29.696381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e08a44-9540-4bd0-b02a-c6f5628abd43 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.698238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ed4cd-7806-49de-bb02-bdef6bae4d04 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.731906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.732678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.733054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.733428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.734364 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] RBAC: Adding query filter params (interface=admin, service_id=63d1bf6c13d740ddb0e288989b7b25eb, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:29.734729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.735110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.735837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.736183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.736352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.736586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.737635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:29.738121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.739707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.747542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 483/978] 10.222.0.76 () {56 vars in 1249 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/endpoints?service_id=63d1bf6c13d740ddb0e288989b7b25eb&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:29.748318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.763076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 496/979] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:29.764054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:29.825932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:29.859715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2d28-06c8-4a06-84f1-ae854a2b0742 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.876693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cb0d-96be-4643-b04b-4b8a5a0eb7e9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:29.896720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421dcb1-16fe-49ed-95b8-596f1104e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.897537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421dcb1-16fe-49ed-95b8-596f1104e819 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.897826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421dcb1-16fe-49ed-95b8-596f1104e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.898103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421dcb1-16fe-49ed-95b8-596f1104e819 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:29.899268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421dcb1-16fe-49ed-95b8-596f1104e819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:29.900845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421dcb1-16fe-49ed-95b8-596f1104e819 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:29.906921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 484/980] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 13:55:29.932902 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:29.933644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:29.933934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:29.934215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.010577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:30.012063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:30.052400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae461-a551-4008-a036-ceff5bac0d28 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:30.052711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae461-a551-4008-a036-ceff5bac0d28 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:30.052990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae461-a551-4008-a036-ceff5bac0d28 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.056735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 485/981] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:30.060391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13c54-e43c-4856-9405-eefa6f1c514d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:30.060682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13c54-e43c-4856-9405-eefa6f1c514d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:30.060960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e13c54-e43c-4856-9405-eefa6f1c514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.070623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:30.087292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-46e13c54-e43c-4856-9405-eefa6f1c514d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:30.088783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46e13c54-e43c-4856-9405-eefa6f1c514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:30.112822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:30.135713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 497/982] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:30.140991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:30.169928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 486/983] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:30.193781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13c54-e43c-4856-9405-eefa6f1c514d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:30.249699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dc567-83df-4c34-b800-9b9dfc6fc14f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:30.284673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:30.285594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:30.286576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:30.286857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.297949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:30.299828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:30.312272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e13c54-e43c-4856-9405-eefa6f1c514d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:30.317826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:30.318841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:30.319731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:30.319731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:30.319731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:30.319731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:30.322744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 498/984] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:30.324531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:30.328678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:30.353926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:30.354652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:30.354938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:30.355218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.356069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:30.357599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:30.376616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 487/985] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:30 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:30.450780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f74e8-e2f5-4fdf-877b-ced12f10759d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:30.494815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:30.495488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:30.495769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:30.496041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.496776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:30.497085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:30.498610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:30.513218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 499/986] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:30.518949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:30.536926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:30.639231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1ec75-6db2-4a2a-90c3-b999049058e3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:30.681070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:30.682004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:30.682441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:30.682747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.690626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:30.692980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:30.709431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:30.710376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:30.711290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:30.711721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 488/987] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:30.716817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:30.792336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:30.843015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821e4e5-4a80-4251-a088-fdb33b6b9d49 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:30.883886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb7051-36e7-4626-a128-942f5a49eb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:30.884551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7051-36e7-4626-a128-942f5a49eb9f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:30.884834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7051-36e7-4626-a128-942f5a49eb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:30.885107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb7051-36e7-4626-a128-942f5a49eb9f None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:30.886021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7051-36e7-4626-a128-942f5a49eb9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:30.886329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7051-36e7-4626-a128-942f5a49eb9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:30.887770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb7051-36e7-4626-a128-942f5a49eb9f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:30.909641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 500/988] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:30.911637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:31.001788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:31.029521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596fb9e-a01d-4a37-b7ad-2d38d4a06bcd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:31.073777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259a66e-614b-4be9-84ce-b4f8d249007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:31.074445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259a66e-614b-4be9-84ce-b4f8d249007d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:31.074730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259a66e-614b-4be9-84ce-b4f8d249007d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:31.075263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259a66e-614b-4be9-84ce-b4f8d249007d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:31.081023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259a66e-614b-4be9-84ce-b4f8d249007d None admin] RBAC: Adding query filter params (role.id=ba55c846780c48acb5c54cf50b8039f8, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=00828d68497c433d80fa2155b21adff4) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:31.081023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259a66e-614b-4be9-84ce-b4f8d249007d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:31.081023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259a66e-614b-4be9-84ce-b4f8d249007d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:31.097387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 489/989] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:30 2022] GET /identity/v3/role_assignments?user.id=00828d68497c433d80fa2155b21adff4&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=ba55c846780c48acb5c54cf50b8039f8 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:32.038580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c725c5-8d6d-4497-b90b-302de8b9aa94 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.039140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c725c5-8d6d-4497-b90b-302de8b9aa94 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.039140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c725c5-8d6d-4497-b90b-302de8b9aa94 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.040753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 501/990] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:32.046077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f6af-3403-48a4-818a-cd2fde231130 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.046483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f6af-3403-48a4-818a-cd2fde231130 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.046648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485f6af-3403-48a4-818a-cd2fde231130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.064678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4485f6af-3403-48a4-818a-cd2fde231130 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:32.065885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4485f6af-3403-48a4-818a-cd2fde231130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:32.145669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 490/991] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:32.167341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c725c5-8d6d-4497-b90b-302de8b9aa94 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:32.274146 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c725c5-8d6d-4497-b90b-302de8b9aa94 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:32.294842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:32.311026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:32.311826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.312100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.312412 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.313071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:32.314464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:32.327134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:32.328110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:32.328941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 502/992] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 13:55:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:32.334521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f6af-3403-48a4-818a-cd2fde231130 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:32.405713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:32.441188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485f6af-3403-48a4-818a-cd2fde231130 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:32.476705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15d53-1953-4004-aebc-3ee8496a1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:32.477536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15d53-1953-4004-aebc-3ee8496a1343 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.477820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15d53-1953-4004-aebc-3ee8496a1343 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.478095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15d53-1953-4004-aebc-3ee8496a1343 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.478803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15d53-1953-4004-aebc-3ee8496a1343 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:32.479110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15d53-1953-4004-aebc-3ee8496a1343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:32.480471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15d53-1953-4004-aebc-3ee8496a1343 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:32.485452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 491/993] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:32.491842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:32.594819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d363fe-8376-41e1-8621-4dc7b6a3ac8f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:32.605734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdcba1-fab4-4322-ad1f-0f2af80341b3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.606031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdcba1-fab4-4322-ad1f-0f2af80341b3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.606318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdcba1-fab4-4322-ad1f-0f2af80341b3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.607837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 492/994] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:32.612542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3384cc-3044-4427-b6be-79c0a5c1dfa7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.612831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3384cc-3044-4427-b6be-79c0a5c1dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.613114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3384cc-3044-4427-b6be-79c0a5c1dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.631262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1d3384cc-3044-4427-b6be-79c0a5c1dfa7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:32.632453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1d3384cc-3044-4427-b6be-79c0a5c1dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:32.634287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:32.635163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.635606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.636038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.636742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:32.637046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:32.638439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:32.643413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 503/995] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 13:55:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:32.649178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:32.700184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:32.709099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 493/996] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:32.731009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3384cc-3044-4427-b6be-79c0a5c1dfa7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:32.752897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61985e-7472-4d53-b6c1-58ac28b8a583 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:32.788940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:32.789624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.790019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.790254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.790994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:32.792356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:32.793901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:32.809229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 504/997] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:32.842545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3384cc-3044-4427-b6be-79c0a5c1dfa7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:32.889615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:32.890346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:32.890630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:32.890905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:32.891563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:32.893043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:32.907806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:32.908886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:32.910216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:32.912156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 494/998] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:32.916352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:33.034725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea87fc0-9b67-40d6-b561-51bfee0e518b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:33.045284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:33.073481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ba1dd-6ce7-4d28-8804-16e7db97d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:33.074142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ba1dd-6ce7-4d28-8804-16e7db97d340 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.074427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ba1dd-6ce7-4d28-8804-16e7db97d340 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.074705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ba1dd-6ce7-4d28-8804-16e7db97d340 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.077485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ba1dd-6ce7-4d28-8804-16e7db97d340 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:33.077485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ba1dd-6ce7-4d28-8804-16e7db97d340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:33.077485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ba1dd-6ce7-4d28-8804-16e7db97d340 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:33.088190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 505/999] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:33.092540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:33.181891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9627f-fdad-4bed-8b87-bef7f9aa73b7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.182207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9627f-fdad-4bed-8b87-bef7f9aa73b7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.182436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9627f-fdad-4bed-8b87-bef7f9aa73b7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.183742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 506/1000] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:33.190377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110979-54e2-4abc-870e-99e3c963888d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.190797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110979-54e2-4abc-870e-99e3c963888d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.191087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1110979-54e2-4abc-870e-99e3c963888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.198938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32036d22-5db9-482f-9866-6fa03e4ed183 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:33.209290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e1110979-54e2-4abc-870e-99e3c963888d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:33.210517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e1110979-54e2-4abc-870e-99e3c963888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:33.223040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:33.236125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:33.236796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.237075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.237370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.238076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] RBAC: Adding query filter params (type=compute) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:33.238911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:33.240278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:33.245165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 495/1001] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:33.250895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:33.288074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 507/1002] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:33.309727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1110979-54e2-4abc-870e-99e3c963888d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:33.361682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46d563-d7dc-4d2c-9d88-14dd477ce5da None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:33.398989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:33.399644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.399923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.400199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.401102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] RBAC: Adding query filter params (interface=public, service_id=6ac33b8149d041d895d30041f19e9d52, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:33.401551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:33.402911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:33.408512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 496/1003] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:55:33 2022] GET /identity/v3/endpoints?service_id=6ac33b8149d041d895d30041f19e9d52&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:33.411045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1110979-54e2-4abc-870e-99e3c963888d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:33.413525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:33.414621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:33.447028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:33.447731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.448008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.448277 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] PATH_INFO: `/v3/services/image` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.448918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:33.450608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:33.462708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:33.463731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:33.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 508/1004] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Jul 18 13:55:33 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:33.468219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:33.470869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:33.525062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bed4-0226-4df8-9ca2-1fe234d89c3c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:33.561276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:33.561978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.562264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.562541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.563227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:33.564606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:33.581378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 497/1005] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:33 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 13:55:33.588715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896777a-b62d-44f7-8848-767a676cccfb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:33.627075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdcedc-8d3a-45b8-9dbb-3bca36f1ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:33.627766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcedc-8d3a-45b8-9dbb-3bca36f1ba00 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.628048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcedc-8d3a-45b8-9dbb-3bca36f1ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.628323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcedc-8d3a-45b8-9dbb-3bca36f1ba00 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.629722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdcedc-8d3a-45b8-9dbb-3bca36f1ba00 None admin] RBAC: Adding query filter params (name=image) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:33.630180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdcedc-8d3a-45b8-9dbb-3bca36f1ba00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:33.631802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effdcedc-8d3a-45b8-9dbb-3bca36f1ba00 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:33.637643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 509/1006] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:33.643449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:33.752695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8bce-59b6-4425-a715-3472654accb6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:33.767210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:33.789942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4991-21e4-4be8-bece-b518fa131333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:33.790612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4991-21e4-4be8-bece-b518fa131333 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:33.790890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4991-21e4-4be8-bece-b518fa131333 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:33.791168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4991-21e4-4be8-bece-b518fa131333 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:33.791868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca4991-21e4-4be8-bece-b518fa131333 None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:33.792168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca4991-21e4-4be8-bece-b518fa131333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:33.793546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca4991-21e4-4be8-bece-b518fa131333 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:33.799567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 498/1007] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:34.886687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e3138-ce60-4cfa-a0bb-5477a30a8f5f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:34.887195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e3138-ce60-4cfa-a0bb-5477a30a8f5f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:34.887274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e3138-ce60-4cfa-a0bb-5477a30a8f5f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:34.888736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 510/1008] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:34.893824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7a1f3-f33c-473f-af60-d8807a24bba6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:34.894258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7a1f3-f33c-473f-af60-d8807a24bba6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:34.894487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7a1f3-f33c-473f-af60-d8807a24bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:34.913086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2aa7a1f3-f33c-473f-af60-d8807a24bba6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:34.914322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2aa7a1f3-f33c-473f-af60-d8807a24bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:34.984008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 499/1009] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:35.006883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e3138-ce60-4cfa-a0bb-5477a30a8f5f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:35.038566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:35.127684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e3138-ce60-4cfa-a0bb-5477a30a8f5f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:35.162998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291271e-48bc-40d7-bf32-2e1ef3fcb7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:35.163710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291271e-48bc-40d7-bf32-2e1ef3fcb7cf None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:35.163990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291271e-48bc-40d7-bf32-2e1ef3fcb7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:35.164261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291271e-48bc-40d7-bf32-2e1ef3fcb7cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:35.165551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291271e-48bc-40d7-bf32-2e1ef3fcb7cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:35.167021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291271e-48bc-40d7-bf32-2e1ef3fcb7cf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:35.168795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 511/1010] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:35.174449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7a1f3-f33c-473f-af60-d8807a24bba6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:35.276105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7a1f3-f33c-473f-af60-d8807a24bba6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:35.289409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:35.315962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72095d-ff6c-4a54-a211-ee8e2adacd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:35.316803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72095d-ff6c-4a54-a211-ee8e2adacd7f None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:35.317176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72095d-ff6c-4a54-a211-ee8e2adacd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:35.317490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72095d-ff6c-4a54-a211-ee8e2adacd7f None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:35.318198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72095d-ff6c-4a54-a211-ee8e2adacd7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:35.319643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72095d-ff6c-4a54-a211-ee8e2adacd7f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:35.350389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 500/1011] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:35 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:35.608341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732449-974d-482e-b3e5-cd80fb971f7d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:35.608662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732449-974d-482e-b3e5-cd80fb971f7d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:35.608903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732449-974d-482e-b3e5-cd80fb971f7d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:35.610441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 512/1012] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:35.616071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518dc4f-193d-4634-bb18-91486ded7b8a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:35.616432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518dc4f-193d-4634-bb18-91486ded7b8a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:35.616718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518dc4f-193d-4634-bb18-91486ded7b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:35.633693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8518dc4f-193d-4634-bb18-91486ded7b8a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:35.634879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8518dc4f-193d-4634-bb18-91486ded7b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:35.705548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 501/1013] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:35.728312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e732449-974d-482e-b3e5-cd80fb971f7d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:35.833035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9638-d240-4717-a87f-40e70e45b9e4 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:35.833487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9638-d240-4717-a87f-40e70e45b9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:35.833621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:35.833784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d9638-d240-4717-a87f-40e70e45b9e4 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:35.835347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 502/1014] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:35.840003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e732449-974d-482e-b3e5-cd80fb971f7d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:35.840642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4630-5dcd-47c4-b674-b18b7516cca1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:35.840999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4630-5dcd-47c4-b674-b18b7516cca1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:35.841361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d4630-5dcd-47c4-b674-b18b7516cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:35.858495 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-315d4630-5dcd-47c4-b674-b18b7516cca1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:35.859698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-315d4630-5dcd-47c4-b674-b18b7516cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:35.878024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:35.879390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:35.879671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:35.880038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:35.880696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:35.882159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:35.893983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:35.897549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:35.898603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 513/1015] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:35.901846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:35.939375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 503/1016] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:35.962413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d4630-5dcd-47c4-b674-b18b7516cca1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:35.983103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:36.010354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baef3e8-3dc0-43a2-bd2c-93600fad1b85 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:36.045642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:36.046306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:36.046591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:36.046869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:36.047584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:36.047887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:36.049263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:36.054836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 514/1017] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:36.060358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:36.080778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d4630-5dcd-47c4-b674-b18b7516cca1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:36.093687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:36.122784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:36.123372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:36.123653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:36.123924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:36.124640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:36.126027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:36.141555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 504/1018] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:55:35 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:36.183945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158ef48-c345-433e-897c-e0361e66e4f4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:36.231280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e114a-9ec3-43d1-99c9-fead9179688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:36.232406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e114a-9ec3-43d1-99c9-fead9179688c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:36.232897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e114a-9ec3-43d1-99c9-fead9179688c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:36.233468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e114a-9ec3-43d1-99c9-fead9179688c None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:36.234382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e114a-9ec3-43d1-99c9-fead9179688c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:36.235051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e114a-9ec3-43d1-99c9-fead9179688c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:36.236707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e114a-9ec3-43d1-99c9-fead9179688c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:36.247276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 515/1019] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 13:55:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:36.249209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:36.341441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:36.364935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd0321-102a-4799-82a1-ec9984e24bb4 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:36.399122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bc113-9412-4af7-a1c1-57aa9023402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:36.400124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc113-9412-4af7-a1c1-57aa9023402a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:36.400663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc113-9412-4af7-a1c1-57aa9023402a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:36.401157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bc113-9412-4af7-a1c1-57aa9023402a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:36.402144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bc113-9412-4af7-a1c1-57aa9023402a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:36.403705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bc113-9412-4af7-a1c1-57aa9023402a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:36.423452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 505/1020] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:37.431577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d668e-b628-476d-9663-49d2fa0b8825 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:37.432067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d668e-b628-476d-9663-49d2fa0b8825 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:37.432067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d668e-b628-476d-9663-49d2fa0b8825 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:37.433594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 516/1021] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:37.438531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abd488-8e2c-4745-a6db-a01be240202c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:37.438922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abd488-8e2c-4745-a6db-a01be240202c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:37.439101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abd488-8e2c-4745-a6db-a01be240202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:37.456054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-78abd488-8e2c-4745-a6db-a01be240202c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:37.457847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-78abd488-8e2c-4745-a6db-a01be240202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:37.530307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 506/1022] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:37.555080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d668e-b628-476d-9663-49d2fa0b8825 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:37.644589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:37.662705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d668e-b628-476d-9663-49d2fa0b8825 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:37.706375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644596e9-75dd-493f-a7d4-83026c8f7db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:37.707953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644596e9-75dd-493f-a7d4-83026c8f7db1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:37.708237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644596e9-75dd-493f-a7d4-83026c8f7db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:37.708512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644596e9-75dd-493f-a7d4-83026c8f7db1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:37.709754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644596e9-75dd-493f-a7d4-83026c8f7db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:37.711257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644596e9-75dd-493f-a7d4-83026c8f7db1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:37.717513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 517/1023] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:37.719129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abd488-8e2c-4745-a6db-a01be240202c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:37.781737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:37.822869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abd488-8e2c-4745-a6db-a01be240202c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:37.857518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ac436-f875-402f-b9d9-1705bfc87e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:37.858192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ac436-f875-402f-b9d9-1705bfc87e8a None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:37.858470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ac436-f875-402f-b9d9-1705bfc87e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:37.858743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ac436-f875-402f-b9d9-1705bfc87e8a None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:37.859444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ac436-f875-402f-b9d9-1705bfc87e8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:37.860881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ac436-f875-402f-b9d9-1705bfc87e8a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:37.889377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 507/1024] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:55:37 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:38.238601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cd92-bc89-4c98-97dc-7fa1dc603f46 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.238966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cd92-bc89-4c98-97dc-7fa1dc603f46 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.239156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cd92-bc89-4c98-97dc-7fa1dc603f46 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.240661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 518/1025] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:38.245770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bc92-108d-4b7e-bd99-60e48ef6b5ce None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.246063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bc92-108d-4b7e-bd99-60e48ef6b5ce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.246343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882bc92-108d-4b7e-bd99-60e48ef6b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.263696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5882bc92-108d-4b7e-bd99-60e48ef6b5ce None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:38.264871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5882bc92-108d-4b7e-bd99-60e48ef6b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:38.336281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 508/1026] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:38.360377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cd92-bc89-4c98-97dc-7fa1dc603f46 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:38.469360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cd92-bc89-4c98-97dc-7fa1dc603f46 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:38.508898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c8a83-a9b2-42cb-8304-cd8b642885e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:38.509769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c8a83-a9b2-42cb-8304-cd8b642885e2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.510055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c8a83-a9b2-42cb-8304-cd8b642885e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.510333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c8a83-a9b2-42cb-8304-cd8b642885e2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.511107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c8a83-a9b2-42cb-8304-cd8b642885e2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:38.512498 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c8a83-a9b2-42cb-8304-cd8b642885e2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-175c8a83-a9b2-42cb-8304-cd8b642885e2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:38.524868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:38.526167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:38.527471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 519/1027] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Jul 18 13:55:38 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:38.532095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bc92-108d-4b7e-bd99-60e48ef6b5ce None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:38.584526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:38.596969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015f91-47fc-45a3-887d-5cdce8fc4d6c None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.597319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015f91-47fc-45a3-887d-5cdce8fc4d6c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.597713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015f91-47fc-45a3-887d-5cdce8fc4d6c None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.599480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 520/1028] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:38.604762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11daa9-397d-4c2a-a874-597a1d7a4416 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.605053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11daa9-397d-4c2a-a874-597a1d7a4416 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.605359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11daa9-397d-4c2a-a874-597a1d7a4416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.622414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1c11daa9-397d-4c2a-a874-597a1d7a4416 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:38.623534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c11daa9-397d-4c2a-a874-597a1d7a4416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:38.637922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:38.641562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882bc92-108d-4b7e-bd99-60e48ef6b5ce None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:38.682985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:38.683666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.683946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.684222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.684925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] RBAC: Adding query filter params (name=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:38.685228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:38.686690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:38.697404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 509/1029] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:38.698088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:38.699106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 521/1030] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:38.724133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11daa9-397d-4c2a-a874-597a1d7a4416 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:38.808529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5620-c2dd-44ca-ae2d-f7f2b03b544e None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:38.822182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:38.833867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11daa9-397d-4c2a-a874-597a1d7a4416 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:38.845187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:38.845887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.846171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.846444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.847175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] RBAC: Adding query filter params (type=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:38.848108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:38.849894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:38.859458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 510/1031] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:38.860468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:38.875511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:38.876246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:38.876526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:38.876799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:38.887350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:38.896403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:38.897376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:38.902484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 522/1032] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 13:55:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:38.903566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:38.916124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:38.980194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb3d90-ac71-4fa6-b7a5-2a10aa068bbb None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.015111 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682643f-24af-4bff-91f0-cc2298a74b63 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.016685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.017368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.017738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.018017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.018818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] RBAC: Adding query filter params (interface=public, service_id=d388163b117b4450b5897d922bf9ff0e, region_id=RegionOne) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:39.019634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:39.021118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:39.026880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 511/1033] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:55:38 2022] GET /identity/v3/endpoints?service_id=d388163b117b4450b5897d922bf9ff0e&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:39.032300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:39.059940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.060610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.060894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.061173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.061962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:39.062274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:39.063642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:39.078101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 523/1034] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 13:55:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:39.082796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:39.082986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:39.154994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8719d87-aa40-4aa2-96a7-56095af4ec01 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.166995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:39.192061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.192842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.193121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.193418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.194110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:39.195475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:39.202516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 512/1035] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:55:39 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 13:55:39.202804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b760e50-2faf-463d-89c1-8425418cfbfa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.242262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.243075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.243360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.243636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.256177 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:39.257718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:39.277544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:39.278520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:39.279421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:39.279421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:39.279421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:39.279421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:39.279421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 524/1036] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:39.289386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:39.400951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901200be-9ebe-4ba9-b52d-8e0e9f494614 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.403377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:39.438653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.439240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.439524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.439802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.440523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:39.440833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:39.443224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:39.460711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 513/1037] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:39.462684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:39.567476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04740bcf-9ed5-4e1b-8d60-64efd4eca774 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.590809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:39.603287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.604059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.604335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.604622 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.613129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:39.614601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:39.629380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:39.630378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:39.631336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:39.633419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 525/1038] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:55:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:39.636806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:39.743287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548636c-5778-4e8c-a4ca-561c646c5cb5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.778853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d929e21-152d-4f86-ac6d-a76a820f60cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.779536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d929e21-152d-4f86-ac6d-a76a820f60cb None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.779818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d929e21-152d-4f86-ac6d-a76a820f60cb None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.780094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d929e21-152d-4f86-ac6d-a76a820f60cb None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.780932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d929e21-152d-4f86-ac6d-a76a820f60cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:39.781244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d929e21-152d-4f86-ac6d-a76a820f60cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:39.782701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d929e21-152d-4f86-ac6d-a76a820f60cb None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:39.806568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 514/1039] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:55:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:39.808129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:39.911489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dc755-9888-41a4-86be-3916d9a91811 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:39.946442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:39.947097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.947381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.947660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.991690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56d39-c711-4a5c-8496-85d217765504 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.991974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56d39-c711-4a5c-8496-85d217765504 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.992258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb56d39-c711-4a5c-8496-85d217765504 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:39.993845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 515/1040] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:39.998404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ffa2c-9c19-4fdc-93d0-724176f05bbe None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:39.998692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ffa2c-9c19-4fdc-93d0-724176f05bbe None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:39.998918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:39.999024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ffa2c-9c19-4fdc-93d0-724176f05bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.015954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ef9ffa2c-9c19-4fdc-93d0-724176f05bbe None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:40.017131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ef9ffa2c-9c19-4fdc-93d0-724176f05bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:40.019835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.021287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.034129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:40.092451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 516/1041] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:40.116271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ffa2c-9c19-4fdc-93d0-724176f05bbe None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.144716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 526/1042] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:40.146286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.217713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ffa2c-9c19-4fdc-93d0-724176f05bbe None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.235016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:40.252423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.253152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.254046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.254340 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.256630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e04eeb-67a4-4eda-9326-b62dd805d7b4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.264491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:40.272910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:40.273926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:40.275000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 517/1043] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:40.280073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.296148 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:40.299295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.300534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.301840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.302269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.313962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.315618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:40.335966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:40.337107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:40.338221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:40.338221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:40.338221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:40.338221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:40.344543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 527/1044] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:40.345656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.397732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38b96c-95df-4d9c-baea-2708c5ae92b8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.434475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.435352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.435637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.435911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.436651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:40.436953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.438349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.446967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 518/1045] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:40.452865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.460275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3ebee-98ed-4175-992b-13a8aca0db26 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.503187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.504803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.505312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.505852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.506867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:40.507178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.508563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.510188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:40.521405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 528/1046] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:40.528909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.534158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:40.566769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf31548-a874-4987-86e6-e8bd887eeb33 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.600285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.601143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.601458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.601725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] PATH_INFO: `/v3/users/bf93001654b24c71916debc6b794f87d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.617509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] RBAC: Authorizing `identity:get_user(user_id=bf93001654b24c71916debc6b794f87d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.618958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.621004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 519/1047] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/users/bf93001654b24c71916debc6b794f87d => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:40.626303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.641691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347487d-d55e-465a-83a2-62eda42e6fc4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.680765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.681842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.682266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.682709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.689542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.691276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:40.705675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:40.707112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:40.708308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 529/1048] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:40.713205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.734981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a785e42-7ccd-4fa5-86d6-a80c6f98acc1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.767240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:40.774431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:40.775277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.776163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.776457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.776867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.823784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73d1f6-150c-49e1-9325-525760e9f659 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:40.852613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.854226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.866346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:40.866967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:40.867248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:40.867538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:40.868299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:40.868604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:40.870048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:40.889674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 530/1049] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:40.891232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:40.973213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 520/1050] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 13:55:40.974271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:41.001400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dbea8-2dda-476e-837b-aaf6da094e9e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:41.009584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:41.017004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:41.039920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:41.040578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.040862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.041142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.042091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] RBAC: Adding query filter params (role.id=ba55c846780c48acb5c54cf50b8039f8, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=85186f8437164bbbb99e007b5c85bd54) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:41.042513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:41.043937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:41.049587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 531/1051] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/role_assignments?user.id=85186f8437164bbbb99e007b5c85bd54&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=ba55c846780c48acb5c54cf50b8039f8 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:41.104032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cccff2-7798-422f-95f8-ed535519e1d1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:41.143296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e1448-969e-4cae-bff6-6ce8a621de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:41.144825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1448-969e-4cae-bff6-6ce8a621de98 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.145108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1448-969e-4cae-bff6-6ce8a621de98 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.145416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1448-969e-4cae-bff6-6ce8a621de98 None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.146680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e1448-969e-4cae-bff6-6ce8a621de98 None admin] RBAC: Authorizing `identity:get_project(project_id=0bae8e6c3dc74f718dc3752f4b0b0606)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:41.148143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e1448-969e-4cae-bff6-6ce8a621de98 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:41.154837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 521/1052] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:55:40 2022] GET /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:41.156174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:41.263988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438afc61-83a1-4673-bf14-e2dce3053fc5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:41.264705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dadea1-5d36-419b-98c9-6e84d63ddbf5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.264997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dadea1-5d36-419b-98c9-6e84d63ddbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.265279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dadea1-5d36-419b-98c9-6e84d63ddbf5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.266697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 522/1053] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:41.272175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffac30-0726-4fc4-99b6-f1693e00f61f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.272463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffac30-0726-4fc4-99b6-f1693e00f61f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.272747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffac30-0726-4fc4-99b6-f1693e00f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.290299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5cffac30-0726-4fc4-99b6-f1693e00f61f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:41.291419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5cffac30-0726-4fc4-99b6-f1693e00f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:41.305891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:41.306808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.307274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.307709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.308713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606, user.id=bf93001654b24c71916debc6b794f87d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:41.309029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:41.310478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:41.316413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 532/1054] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:41 2022] GET /identity/v3/role_assignments?user.id=bf93001654b24c71916debc6b794f87d&scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:41.367019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 523/1055] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:41.391707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:41.439721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:41.503682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b36167-7516-42e1-9cdd-c7182582fbe7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:41.539894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:41.540747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.540977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.541253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] PATH_INFO: `/v3/services/image` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.541953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:41.543320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:41.555166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:41.556187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:41.557018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 533/1056] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Jul 18 13:55:41 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:41.563815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffac30-0726-4fc4-99b6-f1693e00f61f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:41.596204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:41.672833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffac30-0726-4fc4-99b6-f1693e00f61f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:41.709425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:41.710095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.710372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.710642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.711342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] RBAC: Adding query filter params (name=image) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:41.711644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:41.713003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:41.723194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 524/1057] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:41.724469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:41.828405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662ab7f-7275-4d3c-b34f-f24b54558076 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:41.836094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:41.865782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad412a21-c6dc-42c2-b00e-7726483141ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:41.866444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad412a21-c6dc-42c2-b00e-7726483141ae None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:41.866725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad412a21-c6dc-42c2-b00e-7726483141ae None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:41.867001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad412a21-c6dc-42c2-b00e-7726483141ae None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:41.867703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad412a21-c6dc-42c2-b00e-7726483141ae None admin] RBAC: Adding query filter params (type=image) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:41.868007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad412a21-c6dc-42c2-b00e-7726483141ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:41.869386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad412a21-c6dc-42c2-b00e-7726483141ae None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:41.874457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 534/1058] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:41.880516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:41.977662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:41.985567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294f0b8-3415-4466-a7c4-c8ae3d3a7907 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:42.022335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434764fc-731c-493a-9990-64d10c91dfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:42.023004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434764fc-731c-493a-9990-64d10c91dfb3 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:42.023291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434764fc-731c-493a-9990-64d10c91dfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:42.023569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434764fc-731c-493a-9990-64d10c91dfb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:42.024356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434764fc-731c-493a-9990-64d10c91dfb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:42.025779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434764fc-731c-493a-9990-64d10c91dfb3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:42.052131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 525/1059] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:55:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:55:43.083375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295bae-677d-43da-8e57-bec5e7352f66 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.083913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295bae-677d-43da-8e57-bec5e7352f66 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.083913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295bae-677d-43da-8e57-bec5e7352f66 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.085461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 535/1060] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:43.091074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67903df-2d6b-4c08-acda-4ac929c12bad None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.091416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67903df-2d6b-4c08-acda-4ac929c12bad None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.091416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67903df-2d6b-4c08-acda-4ac929c12bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.108696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e67903df-2d6b-4c08-acda-4ac929c12bad None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:43.109905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e67903df-2d6b-4c08-acda-4ac929c12bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:43.187048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 526/1061] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:43.210774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12295bae-677d-43da-8e57-bec5e7352f66 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.316675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12295bae-677d-43da-8e57-bec5e7352f66 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:43.351730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71bf57-b2e7-4e6f-9f8c-4111932c9027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:43.352459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bf57-b2e7-4e6f-9f8c-4111932c9027 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.352739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bf57-b2e7-4e6f-9f8c-4111932c9027 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.353011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bf57-b2e7-4e6f-9f8c-4111932c9027 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.364505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71bf57-b2e7-4e6f-9f8c-4111932c9027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-ff71bf57-b2e7-4e6f-9f8c-4111932c9027 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:43.372819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:43.373802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:43.374637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:43.375763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae843-4471-479b-bac3-57f749e9d99e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.375763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae843-4471-479b-bac3-57f749e9d99e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.375937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bae843-4471-479b-bac3-57f749e9d99e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.377662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 527/1063] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:43.377780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 536/1063] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:43.380561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bae843-4471-479b-bac3-57f749e9d99e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.383393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de887e-b332-4a03-894b-fdb06dcf0c53 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.383683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de887e-b332-4a03-894b-fdb06dcf0c53 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.383962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de887e-b332-4a03-894b-fdb06dcf0c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.404544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-31de887e-b332-4a03-894b-fdb06dcf0c53 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:43.405790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-31de887e-b332-4a03-894b-fdb06dcf0c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:43.435444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:43.467476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:43.493395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 537/1064] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:43.498353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bae843-4471-479b-bac3-57f749e9d99e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:43.511784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de887e-b332-4a03-894b-fdb06dcf0c53 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.535747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:43.536483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.536701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.536978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.537763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:43.538087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:43.539446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:43.548618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 528/1065] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:43.554651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.630759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de887e-b332-4a03-894b-fdb06dcf0c53 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:43.665853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e2b3d-eda6-4d26-8731-2d6938b1a45d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:43.666046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:43.666803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.667084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.667361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.677828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:43.685520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:43.686458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:43.687296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 538/1066] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:43.692862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.706776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:43.708123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.708771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.709383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.716144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:43.723414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:43.727461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:43.729488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:43.749625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:43.750586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:43.756765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:43.756765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:43.756765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:43.756765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:43.756765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 529/1067] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:43.757709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.808812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7260adf-7d35-421a-bbff-0c06fa725f17 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:43.844431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:43.845449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.845896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.846174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.847002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:43.847333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:43.848720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:43.857573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 539/1068] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:43.863353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.866922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162b858-75c7-41f3-a8d2-5de22c519a05 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:43.903218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:43.903804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:43.904084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:43.904355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:43.905071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:43.905526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:43.906882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:43.922048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 530/1069] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:43.927725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:43.950664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:43.972573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165ef34-cca3-49d1-9b52-f242358abffa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:43.986433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.010859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.011728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.012004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.012273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] PATH_INFO: `/v3/users/bf93001654b24c71916debc6b794f87d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.013499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] RBAC: Authorizing `identity:get_user(user_id=bf93001654b24c71916debc6b794f87d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.014913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.022061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 540/1070] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/users/bf93001654b24c71916debc6b794f87d => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:44.023794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.046390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17add1-9625-408b-a6be-ec8a80903a1f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.090511 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc5b3a-7622-463e-b49d-cc054623b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.091346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc5b3a-7622-463e-b49d-cc054623b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.091867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc5b3a-7622-463e-b49d-cc054623b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.091987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc5b3a-7622-463e-b49d-cc054623b8a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.099753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc5b3a-7622-463e-b49d-cc054623b8a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.101201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc5b3a-7622-463e-b49d-cc054623b8a1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-b5fc5b3a-7622-463e-b49d-cc054623b8a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:44.116221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:44.117394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:44.118741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 531/1071] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:55:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:44.119468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc33c1-e2c4-4378-b99a-02ae76fb5cc9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.119468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc33c1-e2c4-4378-b99a-02ae76fb5cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.119615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc33c1-e2c4-4378-b99a-02ae76fb5cc9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.120768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 532/1072] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:44.122924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc33c1-e2c4-4378-b99a-02ae76fb5cc9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.138990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79989c22-d0c5-4cf5-b6a4-4dffb974c0b7 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.172338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff546f5-4427-47fc-9f0c-e02ff6ab7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.173117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff546f5-4427-47fc-9f0c-e02ff6ab7ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.173426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff546f5-4427-47fc-9f0c-e02ff6ab7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.173708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff546f5-4427-47fc-9f0c-e02ff6ab7ad2 None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.175420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff546f5-4427-47fc-9f0c-e02ff6ab7ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=0bae8e6c3dc74f718dc3752f4b0b0606)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.176857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff546f5-4427-47fc-9f0c-e02ff6ab7ad2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.178613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 541/1073] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:44.180009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347bac4-f398-4fd2-b39e-3405dce690a8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.180296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347bac4-f398-4fd2-b39e-3405dce690a8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.180570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347bac4-f398-4fd2-b39e-3405dce690a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.197676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e347bac4-f398-4fd2-b39e-3405dce690a8 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:44.198876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e347bac4-f398-4fd2-b39e-3405dce690a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:44.214688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.228020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc33c1-e2c4-4378-b99a-02ae76fb5cc9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.239490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.263485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.264150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.264430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.264705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.265558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:44.265861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.267278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.270217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 542/1074] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:44.271031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347bac4-f398-4fd2-b39e-3405dce690a8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.286659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 533/1075] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:44.291946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.375314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347bac4-f398-4fd2-b39e-3405dce690a8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.390594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba977cd-925d-467c-a4e4-52ce2f4a92d9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.412168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.413050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.413336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.413651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606/users/bf93001654b24c71916debc6b794f87d/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.415692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] RBAC: Authorizing `identity:create_grant(project_id=0bae8e6c3dc74f718dc3752f4b0b0606, user_id=bf93001654b24c71916debc6b794f87d, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.417121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.426021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.426759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.427043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.427319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.430384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 543/1076] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:55:44 2022] PUT /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606/users/bf93001654b24c71916debc6b794f87d/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:55:44.431185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.437938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.439414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.457005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:44.460780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:44.461854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:44.463667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:44.463667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:44.463667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:44.463667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:44.463667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 534/1077] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:44.468062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.494407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.572002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b4058-2254-48b2-bf38-cd89c332533d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.591508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b6d4-978c-4ea6-be5a-ee540e55fb24 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.615487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.616467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.616767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.617294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.626700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.627369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.627656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.628478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.629315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:44.629653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.631029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.643098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 535/1078] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:44.648993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.697390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.698758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.709890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.738638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.760300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea93b-b52d-4775-9d83-0aba27e6516c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.800382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.801375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.801688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.801974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.808809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 544/1079] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:44.810161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.811678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.814642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:44.827084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:44.828042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:44.828932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 536/1080] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:44.834321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:44.923781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a1ad-6792-460a-87fa-046681c1e685 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.934038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.939401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023f789-edb3-4980-899f-61afaaa18237 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:44.963340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.964057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.964345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.964617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.976187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:44.976337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.976849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:44.977126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:44.977451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:44.977720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.978300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:44.978606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:44.980017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:44.989932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:44.994042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 537/1081] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:44.999275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:45.005388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:45.006269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:45.007165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:45.007165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:45.007165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:45.007165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:45.011783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 545/1082] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:45.012442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:45.114854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49234c54-89c6-4012-bc76-6b7c55ff668d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:45.127446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dff89-9f57-410f-aa02-1e9f656d59bd None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:45.153283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776727d-63ba-4d71-b623-0920c42cb84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:45.154217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776727d-63ba-4d71-b623-0920c42cb84d None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:45.154502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776727d-63ba-4d71-b623-0920c42cb84d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:45.154779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776727d-63ba-4d71-b623-0920c42cb84d None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/85186f8437164bbbb99e007b5c85bd54/roles/ba55c846780c48acb5c54cf50b8039f8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:45.157008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776727d-63ba-4d71-b623-0920c42cb84d None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=85186f8437164bbbb99e007b5c85bd54, role_id=ba55c846780c48acb5c54cf50b8039f8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:45.158476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776727d-63ba-4d71-b623-0920c42cb84d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:45.167419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6726da4-581c-47e7-8aad-155141618cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:45.168138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726da4-581c-47e7-8aad-155141618cdd None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:45.168411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726da4-581c-47e7-8aad-155141618cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:45.168689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6726da4-581c-47e7-8aad-155141618cdd None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:45.169466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726da4-581c-47e7-8aad-155141618cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:45.169779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726da4-581c-47e7-8aad-155141618cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:45.171138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6726da4-581c-47e7-8aad-155141618cdd None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:45.173146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 538/1083] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:55:44 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/85186f8437164bbbb99e007b5c85bd54/roles/ba55c846780c48acb5c54cf50b8039f8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 13:55:45.194663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 546/1084] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:46.464256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e29f4-7d08-4be9-bfbb-85dbc1cdc329 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:46.464776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e29f4-7d08-4be9-bfbb-85dbc1cdc329 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:46.464776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e29f4-7d08-4be9-bfbb-85dbc1cdc329 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:46.466116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 539/1085] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:46.471426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307590-fc3b-484c-8d79-bf603089700e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:46.472619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307590-fc3b-484c-8d79-bf603089700e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:46.472956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307590-fc3b-484c-8d79-bf603089700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:46.489336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0b307590-fc3b-484c-8d79-bf603089700e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:46.490548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0b307590-fc3b-484c-8d79-bf603089700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:46.504455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:46.559653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 547/1086] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:46.583894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e29f4-7d08-4be9-bfbb-85dbc1cdc329 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:46.645635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:46.688720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e29f4-7d08-4be9-bfbb-85dbc1cdc329 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:46.722715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:46.723431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:46.723716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:46.723992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:46.735204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:46.743363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:46.744338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:46.745190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 540/1087] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:46.750627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307590-fc3b-484c-8d79-bf603089700e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:46.852250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307590-fc3b-484c-8d79-bf603089700e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:46.885611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:46.886270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:46.886555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:46.886826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:46.887557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:46.887854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:46.889200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:46.897916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 548/1088] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:46.903773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.002188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01539339-ff9f-46c2-b384-ca45912c837f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.022311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:47.037419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2996d16-cc97-417a-8861-f21c0ed93e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.038279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2996d16-cc97-417a-8861-f21c0ed93e9d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.038559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2996d16-cc97-417a-8861-f21c0ed93e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.038829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2996d16-cc97-417a-8861-f21c0ed93e9d None admin] PATH_INFO: `/v3/users/bf93001654b24c71916debc6b794f87d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.039985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2996d16-cc97-417a-8861-f21c0ed93e9d None admin] RBAC: Authorizing `identity:get_user(user_id=bf93001654b24c71916debc6b794f87d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:47.041442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2996d16-cc97-417a-8861-f21c0ed93e9d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:47.043099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 541/1089] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:46 2022] GET /identity/v3/users/bf93001654b24c71916debc6b794f87d => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:47.048867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.065176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:47.153530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3900d-a88a-4c77-b575-db3121bd0dc8 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.187478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.188124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.188410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.188689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.217270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816e39-bff5-4a8f-8281-8234b34e6eaf None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.217593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816e39-bff5-4a8f-8281-8234b34e6eaf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.217875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816e39-bff5-4a8f-8281-8234b34e6eaf None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.219255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 542/1090] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:55:47.224701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325f243-b975-4229-9d7b-04d255ac4d6e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.224985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325f243-b975-4229-9d7b-04d255ac4d6e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.225267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325f243-b975-4229-9d7b-04d255ac4d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.242080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7325f243-b975-4229-9d7b-04d255ac4d6e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:47.243275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7325f243-b975-4229-9d7b-04d255ac4d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:47.258713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:47.260100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:47.273874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:47.311812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 543/1091] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:55:47.335346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325f243-b975-4229-9d7b-04d255ac4d6e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.359803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 549/1092] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:47.366242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.435077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325f243-b975-4229-9d7b-04d255ac4d6e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.454789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:47.470343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5feb7-c6ea-4364-b7a3-8e19b622a43c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.473938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.474742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.475019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.475287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.484488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:47.485339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:55:47.493927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:47.494922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:47.495757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 544/1093] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 13:55:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:47.501057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.505441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.506310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.506587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.506857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.508048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] RBAC: Authorizing `identity:get_project(project_id=0bae8e6c3dc74f718dc3752f4b0b0606)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:47.509583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:47.511222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 550/1094] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:55:47 2022] GET /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:47.517131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.603751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7ef4-584d-47e1-82f1-835f35cc3b2f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.616730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071ca9-bc14-4b26-bee9-ea7c97b45052 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.637883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.638548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.638828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.639123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.639867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:47.640165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:47.641549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:47.650573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 545/1095] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 13:55:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:47.656235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.657562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.658693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.659263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.659552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.660502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606, user.id=bf93001654b24c71916debc6b794f87d) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:47.660820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:47.662279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:47.668435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 551/1096] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:47 2022] GET /identity/v3/role_assignments?user.id=bf93001654b24c71916debc6b794f87d&scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:47.705524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:47.782767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af6654-12ff-4e61-9c71-3a628944bbc0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.821541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.821773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.821946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.822381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.834957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:47.836417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:47.853447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:47.854353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:47.855400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:47.855400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:47.855400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:47.855400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:47.855400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 546/1097] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:47.860394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:47.909117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:47.964268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20799297-6539-459f-a4ce-4c5a25a06e5f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:47.997254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:47.997931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:47.998215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:47.998492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:47.999210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:47.999517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:48.000884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:48.014024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 552/1098] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:48.019667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:48.115769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:48.124724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3bdc9-364b-492d-8838-0aac795e98c5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:48.158529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:48.159533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:48.159905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:48.160187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:48.167806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:48.169237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:55:48.184262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:48.185207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:55:48.186638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 547/1099] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 13:55:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:48.192372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:48.293606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b604157-b8e9-46ad-b9c6-7d1c115f58aa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:48.295873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:48.328848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:48.329555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:48.329842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:48.330115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:48.331284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:48.331590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:48.333135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:48.351202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 553/1100] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 13:55:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:48.356553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:48.460429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216e663-7e9a-4e80-b1df-9951157ee05c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:48.494122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:48.494779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:48.495064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:48.495344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:48.516262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:48.561525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:48.562964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:48.659191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 548/1101] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:48.665102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:48.763554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a070d44-2773-4916-ad7c-1d72e391c18c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:48.796512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:48.797299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:48.797640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:48.797922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:48.809047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:48.810551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:55:48.831034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:48.832075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:48.833483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:55:48.833483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:55:48.833483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:55:48.833483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:48.833483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 554/1102] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:55:48.837886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:48.894791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:48.942341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a577b4-e7f3-43ba-9829-03f0f5e411b3 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:48.975782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:48.976457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:48.976742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:48.977019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:48.977772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:48.978081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:48.979443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:48.991041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 549/1103] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:55:48.996717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:49.012194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:49.100204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb5eee-feae-405a-8d17-768440ae73e9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:49.133924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:49.134750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:49.135034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:49.135311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:49.142128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:49.143744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:55:49.157306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:55:49.158417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:55:49.160010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 555/1104] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:55:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:55:49.165898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:49.267614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5268-fbd4-4e6e-bba7-9bb1fadc155b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:49.280268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:49.302614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099437e9-0bfd-4144-b702-632525cb5308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:49.303273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099437e9-0bfd-4144-b702-632525cb5308 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:49.303556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099437e9-0bfd-4144-b702-632525cb5308 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:49.303831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099437e9-0bfd-4144-b702-632525cb5308 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:49.304616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099437e9-0bfd-4144-b702-632525cb5308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:49.304925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099437e9-0bfd-4144-b702-632525cb5308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:49.306515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099437e9-0bfd-4144-b702-632525cb5308 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:49.319135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 550/1105] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:55:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:49.325658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:49.402105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:49.428182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c4533-bec5-45b0-86ed-3caecd225890 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:49.463345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174746d-4e6e-49d4-9d30-890181d9ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:49.463992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174746d-4e6e-49d4-9d30-890181d9ce67 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:49.464272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174746d-4e6e-49d4-9d30-890181d9ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:49.464546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174746d-4e6e-49d4-9d30-890181d9ce67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:49.465396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174746d-4e6e-49d4-9d30-890181d9ce67 None admin] RBAC: Adding query filter params (role.id=ba55c846780c48acb5c54cf50b8039f8, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=85186f8437164bbbb99e007b5c85bd54) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:49.465712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174746d-4e6e-49d4-9d30-890181d9ce67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:49.467136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6174746d-4e6e-49d4-9d30-890181d9ce67 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:49.473617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 556/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:49 2022] GET /identity/v3/role_assignments?user.id=85186f8437164bbbb99e007b5c85bd54&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=ba55c846780c48acb5c54cf50b8039f8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:49.744796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff99259-ec37-4947-8396-c7626dfcc9cb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:49.745336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff99259-ec37-4947-8396-c7626dfcc9cb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:49.745336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff99259-ec37-4947-8396-c7626dfcc9cb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:49.746855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 551/1107] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:49.752296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1025f-8c27-44c6-b6a0-8ef5826f43d6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:49.752912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1025f-8c27-44c6-b6a0-8ef5826f43d6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:49.753003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1025f-8c27-44c6-b6a0-8ef5826f43d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:49.770473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-89c1025f-8c27-44c6-b6a0-8ef5826f43d6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:49.771697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-89c1025f-8c27-44c6-b6a0-8ef5826f43d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:49.840704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 557/1108] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:49.865540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff99259-ec37-4947-8396-c7626dfcc9cb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:49.973625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff99259-ec37-4947-8396-c7626dfcc9cb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:50.008412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79459b-489a-42d1-bfcd-77e49f42870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:50.009134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79459b-489a-42d1-bfcd-77e49f42870a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:50.009450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79459b-489a-42d1-bfcd-77e49f42870a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:50.009733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79459b-489a-42d1-bfcd-77e49f42870a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:50.010912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79459b-489a-42d1-bfcd-77e49f42870a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:50.012347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79459b-489a-42d1-bfcd-77e49f42870a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:50.014011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 552/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:55:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:50.020640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1025f-8c27-44c6-b6a0-8ef5826f43d6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:50.097131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:50.131931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1025f-8c27-44c6-b6a0-8ef5826f43d6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:50.166340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80bfe1-ade1-43e3-8f2a-7d251f67f0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:50.167009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80bfe1-ade1-43e3-8f2a-7d251f67f0df None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:50.167284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80bfe1-ade1-43e3-8f2a-7d251f67f0df None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:50.167554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80bfe1-ade1-43e3-8f2a-7d251f67f0df None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:50.168259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80bfe1-ade1-43e3-8f2a-7d251f67f0df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:50.169705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80bfe1-ade1-43e3-8f2a-7d251f67f0df None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:50.189946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 558/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:55:50 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:55:52.250479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0f39-8a9d-4e92-a750-47829a2f86f6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:52.251063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0f39-8a9d-4e92-a750-47829a2f86f6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:52.251063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0f39-8a9d-4e92-a750-47829a2f86f6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:52.252964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 553/1111] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:52.258156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1efade-c8ce-4b4b-81c2-63d63f6738e8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:52.258549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1efade-c8ce-4b4b-81c2-63d63f6738e8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:52.258720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1efade-c8ce-4b4b-81c2-63d63f6738e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:52.275870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2c1efade-c8ce-4b4b-81c2-63d63f6738e8 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:52.277055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2c1efade-c8ce-4b4b-81c2-63d63f6738e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:52.345298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 559/1112] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:52.368182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c0f39-8a9d-4e92-a750-47829a2f86f6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:52.411147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:52.468900 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c0f39-8a9d-4e92-a750-47829a2f86f6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:52.502011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:52.503012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:52.503286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:52.503558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] PATH_INFO: `/v3/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:52.505031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] RBAC: Authorizing `identity:get_role(role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:52.506432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:52.507797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 554/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:52 2022] GET /identity/v3/roles/0778d0e990d0435eaff002965dc033ca => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:52.513826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1efade-c8ce-4b4b-81c2-63d63f6738e8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:52.567396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:52.612792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1efade-c8ce-4b4b-81c2-63d63f6738e8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:52.649013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:52.649901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:52.650184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:52.650458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] PATH_INFO: `/v3/users/e280dbb9cef24ffdb0de81e740c4a835` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:52.663819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] RBAC: Authorizing `identity:get_user(user_id=e280dbb9cef24ffdb0de81e740c4a835)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:52.665266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:52.666941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 560/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:52 2022] GET /identity/v3/users/e280dbb9cef24ffdb0de81e740c4a835 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:52.672682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:52.775810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075dca-7249-46c0-8b42-be0fb3a1cca1 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:52.787388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:52.817258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:52.817933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:52.818214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:52.818487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:52.884037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:52.885417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:52.980842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 555/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:52.986722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:53.092618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650baa81-7ef3-447a-be5d-7cd6815828f4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:53.106189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:53.128557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c0b4a-ca62-4057-bfd5-097b094a59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:53.129447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c0b4a-ca62-4057-bfd5-097b094a59ae None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:53.129731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c0b4a-ca62-4057-bfd5-097b094a59ae None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:53.130008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c0b4a-ca62-4057-bfd5-097b094a59ae None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:53.131185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c0b4a-ca62-4057-bfd5-097b094a59ae None admin] RBAC: Authorizing `identity:get_project(project_id=0bae8e6c3dc74f718dc3752f4b0b0606)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:53.132608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c0b4a-ca62-4057-bfd5-097b094a59ae None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:53.134394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 561/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:55:52 2022] GET /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:53.140433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:53.151032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:53.239257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e959f2-4dd6-4b00-84a4-f2525ae5c97f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:53.271898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e68c90-a1ac-427e-ae59-1155dbe73410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:53.272533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e68c90-a1ac-427e-ae59-1155dbe73410 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:53.272812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e68c90-a1ac-427e-ae59-1155dbe73410 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:53.273085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e68c90-a1ac-427e-ae59-1155dbe73410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:53.273931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e68c90-a1ac-427e-ae59-1155dbe73410 None admin] RBAC: Adding query filter params (role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606, user.id=e280dbb9cef24ffdb0de81e740c4a835) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:53.274240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e68c90-a1ac-427e-ae59-1155dbe73410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:53.275652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e68c90-a1ac-427e-ae59-1155dbe73410 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:53.280901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 556/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:53 2022] GET /identity/v3/role_assignments?user.id=e280dbb9cef24ffdb0de81e740c4a835&scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606&role.id=0778d0e990d0435eaff002965dc033ca => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:55.274563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d71a-600a-4d97-9aaf-1732b7bbdc78 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:55.275115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d71a-600a-4d97-9aaf-1732b7bbdc78 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:55.275115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697d71a-600a-4d97-9aaf-1732b7bbdc78 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:55.276469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 562/1118] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:55.281898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396137-12e3-4e47-8991-b000b175a838 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:55.282324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396137-12e3-4e47-8991-b000b175a838 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:55.282456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30396137-12e3-4e47-8991-b000b175a838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:55.300081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-30396137-12e3-4e47-8991-b000b175a838 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:55.301254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30396137-12e3-4e47-8991-b000b175a838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:55.368653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 557/1119] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:55.391329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d71a-600a-4d97-9aaf-1732b7bbdc78 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:55.493738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697d71a-600a-4d97-9aaf-1732b7bbdc78 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:55.527424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:55.528269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:55.528548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:55.528826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] PATH_INFO: `/v3/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:55.530379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] RBAC: Authorizing `identity:get_role(role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:55.531750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:55.533108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 563/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:55 2022] GET /identity/v3/roles/0778d0e990d0435eaff002965dc033ca => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:55.539578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30396137-12e3-4e47-8991-b000b175a838 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:55.541785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:55.637162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30396137-12e3-4e47-8991-b000b175a838 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:55.670595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:55.671452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:55.671734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:55.672013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] PATH_INFO: `/v3/users/e280dbb9cef24ffdb0de81e740c4a835` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:55.673190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] RBAC: Authorizing `identity:get_user(user_id=e280dbb9cef24ffdb0de81e740c4a835)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:55.674909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:55.676541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 558/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:55 2022] GET /identity/v3/users/e280dbb9cef24ffdb0de81e740c4a835 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:55.682302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:55.730340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:55.779637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925f98-7795-41a1-9003-1ce58a8ccc64 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:55.812423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caec007-2d6d-477e-88ce-0ab56c22de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:55.813263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caec007-2d6d-477e-88ce-0ab56c22de84 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:55.813572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caec007-2d6d-477e-88ce-0ab56c22de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:55.813871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caec007-2d6d-477e-88ce-0ab56c22de84 None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:55.815654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caec007-2d6d-477e-88ce-0ab56c22de84 None admin] RBAC: Authorizing `identity:get_project(project_id=0bae8e6c3dc74f718dc3752f4b0b0606)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:55.817297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caec007-2d6d-477e-88ce-0ab56c22de84 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:55.819003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 564/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:55:55 2022] GET /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:55.825297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:55.893208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:55.924762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fda4c-a706-4274-afa9-35eb23fad980 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:55.957595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c2d90-aba2-426d-ae12-1b28a2368ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:55.958471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2d90-aba2-426d-ae12-1b28a2368ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:55.958746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2d90-aba2-426d-ae12-1b28a2368ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:55.959015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2d90-aba2-426d-ae12-1b28a2368ad6 None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606/users/e280dbb9cef24ffdb0de81e740c4a835/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:55.961158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c2d90-aba2-426d-ae12-1b28a2368ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bae8e6c3dc74f718dc3752f4b0b0606, user_id=e280dbb9cef24ffdb0de81e740c4a835, role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:55.962606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c2d90-aba2-426d-ae12-1b28a2368ad6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:55.975402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 559/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:55:55 2022] PUT /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606/users/e280dbb9cef24ffdb0de81e740c4a835/roles/0778d0e990d0435eaff002965dc033ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:55:57.963919 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749f70e-b0f0-4a86-8ec4-9f0d0a999deb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:57.964451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749f70e-b0f0-4a86-8ec4-9f0d0a999deb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:57.964451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749f70e-b0f0-4a86-8ec4-9f0d0a999deb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:57.965871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 565/1124] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:55:57.971448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dc395-40b5-4a58-842f-42d49aba1458 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:57.971979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dc395-40b5-4a58-842f-42d49aba1458 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:57.971979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dc395-40b5-4a58-842f-42d49aba1458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:57.988413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9e2dc395-40b5-4a58-842f-42d49aba1458 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:55:57.989897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e2dc395-40b5-4a58-842f-42d49aba1458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:55:58.055522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 560/1125] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:55:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:55:58.079118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749f70e-b0f0-4a86-8ec4-9f0d0a999deb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:58.179087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749f70e-b0f0-4a86-8ec4-9f0d0a999deb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:58.195169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:58.213302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:58.214219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:58.214444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:58.214711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] PATH_INFO: `/v3/roles/0778d0e990d0435eaff002965dc033ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:58.216149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] RBAC: Authorizing `identity:get_role(role_id=0778d0e990d0435eaff002965dc033ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:58.217534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:58.218881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 566/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:58 2022] GET /identity/v3/roles/0778d0e990d0435eaff002965dc033ca => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:58.224839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dc395-40b5-4a58-842f-42d49aba1458 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:58.282211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:58.323114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dc395-40b5-4a58-842f-42d49aba1458 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:58.359155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:58.360011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:58.360288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:58.360565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] PATH_INFO: `/v3/users/e280dbb9cef24ffdb0de81e740c4a835` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:58.362038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] RBAC: Authorizing `identity:get_user(user_id=e280dbb9cef24ffdb0de81e740c4a835)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:58.363461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:58.365113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 561/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:55:58 2022] GET /identity/v3/users/e280dbb9cef24ffdb0de81e740c4a835 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:58.371793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:58.468980 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebe15d-67e9-4cb0-b14f-3238780017b1 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:58.500932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:58.501584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:58.502428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:58.502700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:58.552374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:58.568020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:58.569464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:58.671063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 567/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:55:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:55:58.679333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:58.776138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524df59-0e14-4236-8446-8e170dba0851 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:58.801988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:58.809888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c032a-a82c-424f-b5db-322fdccb44b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:58.810732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c032a-a82c-424f-b5db-322fdccb44b7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:58.811010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c032a-a82c-424f-b5db-322fdccb44b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:58.811282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c032a-a82c-424f-b5db-322fdccb44b7 None admin] PATH_INFO: `/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:58.812438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c032a-a82c-424f-b5db-322fdccb44b7 None admin] RBAC: Authorizing `identity:get_project(project_id=0bae8e6c3dc74f718dc3752f4b0b0606)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:58.813897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c032a-a82c-424f-b5db-322fdccb44b7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:58.815627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 562/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:55:58 2022] GET /identity/v3/projects/0bae8e6c3dc74f718dc3752f4b0b0606 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:55:58.821767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:55:58.901291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:55:58.918012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c8c58-8920-4971-8760-b1e2564a1859 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:55:58.951959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe8a15-290c-4916-b184-531f89ea186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:55:58.952606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe8a15-290c-4916-b184-531f89ea186e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:55:58.952890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe8a15-290c-4916-b184-531f89ea186e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:55:58.953165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe8a15-290c-4916-b184-531f89ea186e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:55:58.954117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe8a15-290c-4916-b184-531f89ea186e None admin] RBAC: Adding query filter params (role.id=0778d0e990d0435eaff002965dc033ca, scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606, user.id=e280dbb9cef24ffdb0de81e740c4a835) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:55:58.954426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe8a15-290c-4916-b184-531f89ea186e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:55:58.956039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe8a15-290c-4916-b184-531f89ea186e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:55:58.962052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 568/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:55:58 2022] GET /identity/v3/role_assignments?user.id=e280dbb9cef24ffdb0de81e740c4a835&scope.project.id=0bae8e6c3dc74f718dc3752f4b0b0606&role.id=0778d0e990d0435eaff002965dc033ca => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:00.988914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bd103-cdc9-47e0-a1a4-6804d4d7f97a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:00.989513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bd103-cdc9-47e0-a1a4-6804d4d7f97a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:00.989513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bd103-cdc9-47e0-a1a4-6804d4d7f97a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:00.990978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 563/1131] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:00.996022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4f07-f6b4-4a37-88ae-46bf04e310fa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:00.996394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4f07-f6b4-4a37-88ae-46bf04e310fa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:00.996571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d4f07-f6b4-4a37-88ae-46bf04e310fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:01.012768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-400d4f07-f6b4-4a37-88ae-46bf04e310fa None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:01.013967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-400d4f07-f6b4-4a37-88ae-46bf04e310fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:01.078252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 569/1132] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:01.101237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bd103-cdc9-47e0-a1a4-6804d4d7f97a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:01.201096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bd103-cdc9-47e0-a1a4-6804d4d7f97a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:01.235706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193dab1-7bea-49d8-85d1-fdcdf14b828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:01.236531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193dab1-7bea-49d8-85d1-fdcdf14b828a None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:01.236810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193dab1-7bea-49d8-85d1-fdcdf14b828a None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:01.237081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193dab1-7bea-49d8-85d1-fdcdf14b828a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:01.238262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193dab1-7bea-49d8-85d1-fdcdf14b828a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:01.239741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193dab1-7bea-49d8-85d1-fdcdf14b828a None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:01.241449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 564/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:56:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:01.247531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d4f07-f6b4-4a37-88ae-46bf04e310fa None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:01.324123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:01.346334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d4f07-f6b4-4a37-88ae-46bf04e310fa None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:01.380164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d3c15-96e8-4ec5-8004-1e09aec69ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:01.380812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3c15-96e8-4ec5-8004-1e09aec69ddf None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:01.381094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3c15-96e8-4ec5-8004-1e09aec69ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:01.381458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d3c15-96e8-4ec5-8004-1e09aec69ddf None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:01.382099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d3c15-96e8-4ec5-8004-1e09aec69ddf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:01.383508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d3c15-96e8-4ec5-8004-1e09aec69ddf None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:01.408691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 570/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:56:01 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:56:03.478205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a3687-034e-4c2d-804d-bf51b22f998e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:03.478727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a3687-034e-4c2d-804d-bf51b22f998e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:03.478727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a3687-034e-4c2d-804d-bf51b22f998e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:03.480024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 565/1135] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:03.485157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb233-b782-4b35-8dd4-194404f7477d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:03.485561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb233-b782-4b35-8dd4-194404f7477d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:03.485784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb233-b782-4b35-8dd4-194404f7477d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:03.502842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ef1bb233-b782-4b35-8dd4-194404f7477d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:03.504025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ef1bb233-b782-4b35-8dd4-194404f7477d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:03.570443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 571/1136] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:56:03.594762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a3687-034e-4c2d-804d-bf51b22f998e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:03.658190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:03.697299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a3687-034e-4c2d-804d-bf51b22f998e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:03.730069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066d76a-6832-4a11-8f7e-db0ed2741536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:03.730796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d76a-6832-4a11-8f7e-db0ed2741536 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:03.731077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d76a-6832-4a11-8f7e-db0ed2741536 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:03.731351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066d76a-6832-4a11-8f7e-db0ed2741536 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:03.732508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066d76a-6832-4a11-8f7e-db0ed2741536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:03.733970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e066d76a-6832-4a11-8f7e-db0ed2741536 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:03.736132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 566/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:56:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:03.741932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb233-b782-4b35-8dd4-194404f7477d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:03.798054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:03.841379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb233-b782-4b35-8dd4-194404f7477d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:03.874824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1fa6-68a4-4e68-b919-1e2beba702ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:03.875478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1fa6-68a4-4e68-b919-1e2beba702ac None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:03.875758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1fa6-68a4-4e68-b919-1e2beba702ac None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:03.876032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1fa6-68a4-4e68-b919-1e2beba702ac None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:03.877476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe1fa6-68a4-4e68-b919-1e2beba702ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:03.878901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe1fa6-68a4-4e68-b919-1e2beba702ac None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:03.897769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 572/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:56:03 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:56:05.960962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82aef6-e2ed-40a5-bc69-621fc26de939 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:05.961545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82aef6-e2ed-40a5-bc69-621fc26de939 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:05.961545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82aef6-e2ed-40a5-bc69-621fc26de939 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:05.963931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 567/1139] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:05.969039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6a79-b52a-4e34-b758-6386ac7cdccd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:05.969479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6a79-b52a-4e34-b758-6386ac7cdccd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:05.969621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6a79-b52a-4e34-b758-6386ac7cdccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:05.986522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5c7e6a79-b52a-4e34-b758-6386ac7cdccd None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:05.987694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5c7e6a79-b52a-4e34-b758-6386ac7cdccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:06.057877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 573/1140] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:06.081800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82aef6-e2ed-40a5-bc69-621fc26de939 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:06.179562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82aef6-e2ed-40a5-bc69-621fc26de939 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:06.208041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:06.213234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:06.213977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:06.214256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:06.214527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:06.224901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:56:06.232392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:56:06.233560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:56:06.234465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 568/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:56:06.239683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6a79-b52a-4e34-b758-6386ac7cdccd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:06.287138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:06.340342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6a79-b52a-4e34-b758-6386ac7cdccd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:06.372507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:06.373149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:06.373500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:06.373725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:06.374460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:06.374759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:06.376626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:06.384502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 574/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:06.390243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:06.487532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf019c6-fdfb-4851-b041-2fcaf47958bd None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:06.520353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f589-df62-413d-8e63-f8378073948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:06.521208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f589-df62-413d-8e63-f8378073948f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:06.521514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f589-df62-413d-8e63-f8378073948f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:06.521785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896f589-df62-413d-8e63-f8378073948f None admin] PATH_INFO: `/v3/users/32c90d895ed846bba0c6db7c79a3a74a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:06.534553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896f589-df62-413d-8e63-f8378073948f None admin] RBAC: Authorizing `identity:get_user(user_id=32c90d895ed846bba0c6db7c79a3a74a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:06.535987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896f589-df62-413d-8e63-f8378073948f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:06.537646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 569/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:56:06 2022] GET /identity/v3/users/32c90d895ed846bba0c6db7c79a3a74a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:06.543478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:06.642378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a140a-d1df-411f-bb51-f39b3644bc89 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:06.650781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:06.676114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:06.676752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:06.677035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:06.677314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:06.743249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:06.744626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:06.841438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 575/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:56:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:56:06.848001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f589-df62-413d-8e63-f8378073948f None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:06.895943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:06.944206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896f589-df62-413d-8e63-f8378073948f None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:06.977299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516431-01b4-4c7d-b73f-bafe795b6620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:06.978166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516431-01b4-4c7d-b73f-bafe795b6620 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:06.978443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516431-01b4-4c7d-b73f-bafe795b6620 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:06.978715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516431-01b4-4c7d-b73f-bafe795b6620 None admin] PATH_INFO: `/v3/projects/48560e1c00c940388ed29ba2c4fedb96` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:06.979864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516431-01b4-4c7d-b73f-bafe795b6620 None admin] RBAC: Authorizing `identity:get_project(project_id=48560e1c00c940388ed29ba2c4fedb96)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:06.981283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516431-01b4-4c7d-b73f-bafe795b6620 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:06.982980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 570/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:56:06 2022] GET /identity/v3/projects/48560e1c00c940388ed29ba2c4fedb96 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:06.989798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:06.999846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:07.088341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d3f01-01f7-4801-9bec-abbe3740c830 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:07.122755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbadd2-0e5c-4b7c-97fc-bef5c8506172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:07.123401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbadd2-0e5c-4b7c-97fc-bef5c8506172 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:07.123683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbadd2-0e5c-4b7c-97fc-bef5c8506172 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:07.123958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbadd2-0e5c-4b7c-97fc-bef5c8506172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:07.124782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbadd2-0e5c-4b7c-97fc-bef5c8506172 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=48560e1c00c940388ed29ba2c4fedb96, user.id=32c90d895ed846bba0c6db7c79a3a74a) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:07.125092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbadd2-0e5c-4b7c-97fc-bef5c8506172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:07.127213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbadd2-0e5c-4b7c-97fc-bef5c8506172 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:07.132494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 576/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:56:06 2022] GET /identity/v3/role_assignments?user.id=32c90d895ed846bba0c6db7c79a3a74a&scope.project.id=48560e1c00c940388ed29ba2c4fedb96&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:09.121421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138d002-0b2b-41d5-a241-040b6feafe20 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:09.121910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138d002-0b2b-41d5-a241-040b6feafe20 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:09.122011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138d002-0b2b-41d5-a241-040b6feafe20 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:09.123339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 571/1147] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:09.128814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d3ac4-5ca2-441d-9d4a-ada972eb026f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:09.129238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d3ac4-5ca2-441d-9d4a-ada972eb026f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:09.129418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d3ac4-5ca2-441d-9d4a-ada972eb026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:09.147009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c73d3ac4-5ca2-441d-9d4a-ada972eb026f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:09.148204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c73d3ac4-5ca2-441d-9d4a-ada972eb026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:09.213445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 577/1148] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:09.236382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138d002-0b2b-41d5-a241-040b6feafe20 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:09.337940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138d002-0b2b-41d5-a241-040b6feafe20 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:09.356078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:09.372874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:09.373689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:09.373974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:09.374250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:09.384654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:56:09.393282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:56:09.394477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:56:09.395688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 572/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:56:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:56:09.400614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d3ac4-5ca2-441d-9d4a-ada972eb026f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:09.402804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:09.500793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d3ac4-5ca2-441d-9d4a-ada972eb026f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:09.534400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:09.535055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:09.535339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:09.535612 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:09.536349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:09.536653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:09.538033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:09.545873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 578/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:09.552435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:09.651870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273843b3-4e61-4641-82d3-06a4f9fd4589 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:09.685190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:09.686071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:09.686355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:09.686630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] PATH_INFO: `/v3/users/32c90d895ed846bba0c6db7c79a3a74a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:09.687819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] RBAC: Authorizing `identity:get_user(user_id=32c90d895ed846bba0c6db7c79a3a74a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:09.689488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:09.691107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 573/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:56:09 2022] GET /identity/v3/users/32c90d895ed846bba0c6db7c79a3a74a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:09.697226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:09.758945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:09.795122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0e2d5-625a-49bc-80f6-866dfc5cf6c6 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:09.828344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2064c-84e0-4daf-b078-6ad247142f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:09.829367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2064c-84e0-4daf-b078-6ad247142f4f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:09.829656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2064c-84e0-4daf-b078-6ad247142f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:09.829952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2064c-84e0-4daf-b078-6ad247142f4f None admin] PATH_INFO: `/v3/projects/48560e1c00c940388ed29ba2c4fedb96` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:09.831138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2064c-84e0-4daf-b078-6ad247142f4f None admin] RBAC: Authorizing `identity:get_project(project_id=48560e1c00c940388ed29ba2c4fedb96)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:09.832556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2064c-84e0-4daf-b078-6ad247142f4f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:09.834282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 579/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:56:09 2022] GET /identity/v3/projects/48560e1c00c940388ed29ba2c4fedb96 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:09.840310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:09.886252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:09.939354 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b44a7c-f943-4ea1-9005-673a2b852672 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:09.971987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb93066-173b-4b48-93f0-1f49debec823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:09.972865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93066-173b-4b48-93f0-1f49debec823 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:09.973150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93066-173b-4b48-93f0-1f49debec823 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:09.973457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb93066-173b-4b48-93f0-1f49debec823 None admin] PATH_INFO: `/v3/projects/48560e1c00c940388ed29ba2c4fedb96/users/32c90d895ed846bba0c6db7c79a3a74a/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:09.975407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb93066-173b-4b48-93f0-1f49debec823 None admin] RBAC: Authorizing `identity:create_grant(project_id=48560e1c00c940388ed29ba2c4fedb96, user_id=32c90d895ed846bba0c6db7c79a3a74a, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:09.976833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb93066-173b-4b48-93f0-1f49debec823 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:09.990825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 574/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:56:09 2022] PUT /identity/v3/projects/48560e1c00c940388ed29ba2c4fedb96/users/32c90d895ed846bba0c6db7c79a3a74a/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:56:11.982656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56224df-73e9-4f96-9471-83296cf89552 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:11.983222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56224df-73e9-4f96-9471-83296cf89552 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:11.983222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56224df-73e9-4f96-9471-83296cf89552 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:11.984574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 580/1154] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:11.990563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cbcc9-32b4-49ac-80c5-33e8f38a15a7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:11.990951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cbcc9-32b4-49ac-80c5-33e8f38a15a7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:11.991121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cbcc9-32b4-49ac-80c5-33e8f38a15a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:12.008225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-541cbcc9-32b4-49ac-80c5-33e8f38a15a7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:12.009440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-541cbcc9-32b4-49ac-80c5-33e8f38a15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:12.075484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 575/1155] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:12.099250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56224df-73e9-4f96-9471-83296cf89552 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:12.206242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56224df-73e9-4f96-9471-83296cf89552 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:12.234387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:12.240512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:12.241292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:12.241686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:12.241962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:12.252330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:56:12.260003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:56:12.261119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:56:12.262220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 581/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:56:12.267799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cbcc9-32b4-49ac-80c5-33e8f38a15a7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:12.302670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:12.366932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cbcc9-32b4-49ac-80c5-33e8f38a15a7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:12.400222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:12.400883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:12.401166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:12.401475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:12.402222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:12.402530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:12.403894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:12.412325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 576/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:56:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:56:12.418198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:12.513740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd17a4-e6a7-412e-9317-bee3023822a0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:12.546076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:12.546917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:12.547192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:12.548150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] PATH_INFO: `/v3/users/32c90d895ed846bba0c6db7c79a3a74a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:12.549388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] RBAC: Authorizing `identity:get_user(user_id=32c90d895ed846bba0c6db7c79a3a74a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:12.550814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:12.552408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 582/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:56:12 2022] GET /identity/v3/users/32c90d895ed846bba0c6db7c79a3a74a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:12.558382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:12.654937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:12.659762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91971be2-23f5-47ba-af2d-90069cfbe0a0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:12.692498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:12.693140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:12.693454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:12.693737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:12.759705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:12.761140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:12.854687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:12.859504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 577/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:56:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 13:56:12.867561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:12.927117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:12.967917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a2b2c-bf68-4abc-a8c4-327f89654b1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:13.000816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f59aa-b5a4-4e24-8e64-760cd204131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:13.001824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f59aa-b5a4-4e24-8e64-760cd204131b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:13.002108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f59aa-b5a4-4e24-8e64-760cd204131b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:13.002380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f59aa-b5a4-4e24-8e64-760cd204131b None admin] PATH_INFO: `/v3/projects/48560e1c00c940388ed29ba2c4fedb96` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:13.003554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f59aa-b5a4-4e24-8e64-760cd204131b None admin] RBAC: Authorizing `identity:get_project(project_id=48560e1c00c940388ed29ba2c4fedb96)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:13.004962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f59aa-b5a4-4e24-8e64-760cd204131b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:13.006668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 583/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:56:12 2022] GET /identity/v3/projects/48560e1c00c940388ed29ba2c4fedb96 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:13.012842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:13.112429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70384895-e6ea-4ce6-8c7d-433c3146c287 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:13.145978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7658e0-d04c-481b-a58b-d6cf985a3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:13.146621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7658e0-d04c-481b-a58b-d6cf985a3e1c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:13.146905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7658e0-d04c-481b-a58b-d6cf985a3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:13.147181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7658e0-d04c-481b-a58b-d6cf985a3e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:13.148036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7658e0-d04c-481b-a58b-d6cf985a3e1c None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=48560e1c00c940388ed29ba2c4fedb96, user.id=32c90d895ed846bba0c6db7c79a3a74a) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:13.148347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7658e0-d04c-481b-a58b-d6cf985a3e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:13.149804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7658e0-d04c-481b-a58b-d6cf985a3e1c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:13.155608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 578/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:56:13 2022] GET /identity/v3/role_assignments?user.id=32c90d895ed846bba0c6db7c79a3a74a&scope.project.id=48560e1c00c940388ed29ba2c4fedb96&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:15.213480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4008-2e7e-42a1-9c23-5e788a9c8159 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:15.213991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4008-2e7e-42a1-9c23-5e788a9c8159 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:15.214083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa4008-2e7e-42a1-9c23-5e788a9c8159 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:15.215396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 584/1162] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:15.220870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a3b9-a4e4-4c8b-99b4-4d0dc33b83e4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:15.221400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a3b9-a4e4-4c8b-99b4-4d0dc33b83e4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:15.221507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9a3b9-a4e4-4c8b-99b4-4d0dc33b83e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:15.238315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fba9a3b9-a4e4-4c8b-99b4-4d0dc33b83e4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:15.239489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fba9a3b9-a4e4-4c8b-99b4-4d0dc33b83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:15.295176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:15.306062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 579/1163] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:15.329499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa4008-2e7e-42a1-9c23-5e788a9c8159 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:15.428223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa4008-2e7e-42a1-9c23-5e788a9c8159 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:15.455241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:15.463238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:15.463877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:15.464161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:15.464436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:15.529359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:15.530808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:15.626992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 585/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:56:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:56:15.633124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a3b9-a4e4-4c8b-99b4-4d0dc33b83e4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:15.732307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9a3b9-a4e4-4c8b-99b4-4d0dc33b83e4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:15.764947 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cec95-6ae9-4aa8-ba29-28f57da76fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:15.766251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cec95-6ae9-4aa8-ba29-28f57da76fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:15.766706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cec95-6ae9-4aa8-ba29-28f57da76fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:15.767092 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cec95-6ae9-4aa8-ba29-28f57da76fb9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:15.773628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cec95-6ae9-4aa8-ba29-28f57da76fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:15.775061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cec95-6ae9-4aa8-ba29-28f57da76fb9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-924cec95-6ae9-4aa8-ba29-28f57da76fb9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:56:15.789742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:56:15.791006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:56:15.792063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 580/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:56:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:56:15.797121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:15.824161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:15.895116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eed07-9502-431c-8710-99e4a54d1c27 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:15.928344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070734-f591-437d-99f1-2e5f0c3a76ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:15.929001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070734-f591-437d-99f1-2e5f0c3a76ae None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:15.929282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070734-f591-437d-99f1-2e5f0c3a76ae None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:15.929588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070734-f591-437d-99f1-2e5f0c3a76ae None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:15.930305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070734-f591-437d-99f1-2e5f0c3a76ae None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:15.930610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070734-f591-437d-99f1-2e5f0c3a76ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:15.931970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070734-f591-437d-99f1-2e5f0c3a76ae None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:15.939148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 586/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 13:56:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:17.934650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d667-eae6-4e18-bc2d-f0ca3ad30405 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:17.935189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d667-eae6-4e18-bc2d-f0ca3ad30405 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:17.935189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9d667-eae6-4e18-bc2d-f0ca3ad30405 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:17.936578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 581/1167] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:17.941827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2099bc-e83b-4270-ad31-5b1e0029f34d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:17.942243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2099bc-e83b-4270-ad31-5b1e0029f34d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:17.942398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2099bc-e83b-4270-ad31-5b1e0029f34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:17.959939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5c2099bc-e83b-4270-ad31-5b1e0029f34d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:17.961135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5c2099bc-e83b-4270-ad31-5b1e0029f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:18.026502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 587/1168] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:18.050555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d667-eae6-4e18-bc2d-f0ca3ad30405 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:18.106895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:18.154902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9d667-eae6-4e18-bc2d-f0ca3ad30405 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:18.187372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76da69-c09c-41ca-abab-0c66f7f19b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:18.188098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76da69-c09c-41ca-abab-0c66f7f19b02 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:18.188376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76da69-c09c-41ca-abab-0c66f7f19b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:18.188651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76da69-c09c-41ca-abab-0c66f7f19b02 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:18.189420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76da69-c09c-41ca-abab-0c66f7f19b02 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:18.190784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76da69-c09c-41ca-abab-0c66f7f19b02 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:18.205611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 582/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Mon Jul 18 13:56:18 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:56:20.251931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283bd5-b122-4982-b855-79a4a51891a9 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:20.252527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283bd5-b122-4982-b855-79a4a51891a9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:20.252527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283bd5-b122-4982-b855-79a4a51891a9 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:20.253956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 588/1170] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:20.259360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da45e2-0d2d-49c8-885e-755d87cdbfbb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:20.259792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da45e2-0d2d-49c8-885e-755d87cdbfbb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:20.259917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da45e2-0d2d-49c8-885e-755d87cdbfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:20.278453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-75da45e2-0d2d-49c8-885e-755d87cdbfbb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:20.279640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75da45e2-0d2d-49c8-885e-755d87cdbfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:20.346557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 583/1171] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:20.369399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa283bd5-b122-4982-b855-79a4a51891a9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:20.393929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:20.471810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa283bd5-b122-4982-b855-79a4a51891a9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:20.505020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dd607-dc01-47a4-8d22-c6e08cdc2bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:20.505888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dd607-dc01-47a4-8d22-c6e08cdc2bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:20.506166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dd607-dc01-47a4-8d22-c6e08cdc2bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:20.506438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dd607-dc01-47a4-8d22-c6e08cdc2bd3 None admin] PATH_INFO: `/v3/domains/74483ac66c1843bda1159cb3d80df04b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:20.517112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dd607-dc01-47a4-8d22-c6e08cdc2bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=74483ac66c1843bda1159cb3d80df04b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:20.518573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dd607-dc01-47a4-8d22-c6e08cdc2bd3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:20.520176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 589/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Mon Jul 18 13:56:20 2022] GET /identity/v3/domains/74483ac66c1843bda1159cb3d80df04b => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:20.526092 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da45e2-0d2d-49c8-885e-755d87cdbfbb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:20.570560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:20.627675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da45e2-0d2d-49c8-885e-755d87cdbfbb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:20.660395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b20a40-f415-486b-85ac-40aca2c7af3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:20.661043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b20a40-f415-486b-85ac-40aca2c7af3c None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:20.661321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b20a40-f415-486b-85ac-40aca2c7af3c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:20.661623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b20a40-f415-486b-85ac-40aca2c7af3c None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:20.662334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b20a40-f415-486b-85ac-40aca2c7af3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:20.663751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b20a40-f415-486b-85ac-40aca2c7af3c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:20.691736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 584/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:56:20 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 13:56:22.726430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1916124-8918-4b35-a03f-bc7fead76340 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:22.726986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1916124-8918-4b35-a03f-bc7fead76340 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:22.726986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1916124-8918-4b35-a03f-bc7fead76340 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:22.728322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 590/1174] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:22.733427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe4b6-1ef2-456b-aea9-7254127af018 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:22.733899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe4b6-1ef2-456b-aea9-7254127af018 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:22.734041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafe4b6-1ef2-456b-aea9-7254127af018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:22.750380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5bafe4b6-1ef2-456b-aea9-7254127af018 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:22.751554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5bafe4b6-1ef2-456b-aea9-7254127af018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:22.816367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 585/1175] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:22.841122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1916124-8918-4b35-a03f-bc7fead76340 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:22.921506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:22.941370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1916124-8918-4b35-a03f-bc7fead76340 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:22.974753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cb4aa-32ca-48aa-8e53-2a886c45c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:22.975683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb4aa-32ca-48aa-8e53-2a886c45c0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:22.975965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb4aa-32ca-48aa-8e53-2a886c45c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:22.976237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb4aa-32ca-48aa-8e53-2a886c45c0e4 None admin] PATH_INFO: `/v3/domains/74483ac66c1843bda1159cb3d80df04b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:22.977484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cb4aa-32ca-48aa-8e53-2a886c45c0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=74483ac66c1843bda1159cb3d80df04b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:22.978858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cb4aa-32ca-48aa-8e53-2a886c45c0e4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:22.980459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 591/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Mon Jul 18 13:56:22 2022] GET /identity/v3/domains/74483ac66c1843bda1159cb3d80df04b => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:22.987502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafe4b6-1ef2-456b-aea9-7254127af018 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:23.013609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:23.090849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafe4b6-1ef2-456b-aea9-7254127af018 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:23.123484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cb13e-9895-4185-a01d-59842eb5fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:23.124148 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb13e-9895-4185-a01d-59842eb5fe25 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:23.124938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb13e-9895-4185-a01d-59842eb5fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:23.125264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cb13e-9895-4185-a01d-59842eb5fe25 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:23.126117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb13e-9895-4185-a01d-59842eb5fe25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:23.127557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cb13e-9895-4185-a01d-59842eb5fe25 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:23.147714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 586/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:56:22 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:56:25.207720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affebc6-8473-4645-befb-c4d166f9b747 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:25.208270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affebc6-8473-4645-befb-c4d166f9b747 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:25.208270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affebc6-8473-4645-befb-c4d166f9b747 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:25.209670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 592/1178] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:25.214969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb447-0642-4842-976a-7f91acd72d64 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:25.215389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb447-0642-4842-976a-7f91acd72d64 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:25.215528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb447-0642-4842-976a-7f91acd72d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:25.232355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4f1cb447-0642-4842-976a-7f91acd72d64 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:25.233565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4f1cb447-0642-4842-976a-7f91acd72d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:25.298841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 587/1179] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:25.321263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affebc6-8473-4645-befb-c4d166f9b747 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:25.420706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affebc6-8473-4645-befb-c4d166f9b747 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:25.454045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:25.454819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:25.455108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:25.455383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:25.465229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:56:25.472890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:56:25.474100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:56:25.475453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 593/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:56:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:56:25.480175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb447-0642-4842-976a-7f91acd72d64 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:25.492159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:25.578767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb447-0642-4842-976a-7f91acd72d64 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:25.612308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:25.612966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:25.613243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:25.613545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:25.614282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:25.614587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:25.615943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:25.623731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 588/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:56:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:25.630206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:25.643495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:25.731508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6910150-427c-479d-b60f-b8d42637d930 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:25.763671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:25.764535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:25.765330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:25.765770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] PATH_INFO: `/v3/users/cad3b0ff278040fabd6869fd783df233` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:25.778548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] RBAC: Authorizing `identity:get_user(user_id=cad3b0ff278040fabd6869fd783df233)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:25.779981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:25.782430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 594/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:56:25 2022] GET /identity/v3/users/cad3b0ff278040fabd6869fd783df233 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:25.788254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:25.858426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:25.888250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0de2a-63dc-4c64-83e4-c1c31b1a2748 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:25.924432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:25.925089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:25.925391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:25.925675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:25.997321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:25.998723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:26.065256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:26.096178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 589/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:56:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:56:26.101983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:26.169150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:26.202070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c8eb-5c65-4622-a512-f83c3450f2fa None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:26.236211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093e810-e2ff-4059-a502-3ff43cfeb3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:26.237073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093e810-e2ff-4059-a502-3ff43cfeb3eb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:26.237372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093e810-e2ff-4059-a502-3ff43cfeb3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:26.237663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093e810-e2ff-4059-a502-3ff43cfeb3eb None admin] PATH_INFO: `/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:26.238842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093e810-e2ff-4059-a502-3ff43cfeb3eb None admin] RBAC: Authorizing `identity:get_project(project_id=7ff5cd6d70d8421f8fa606bc48dfda24)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:26.240266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093e810-e2ff-4059-a502-3ff43cfeb3eb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:26.241990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 595/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:56:26 2022] GET /identity/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:26.248145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:26.350819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03854e28-14be-4b6c-b176-df2b59c1597c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:26.383751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6757f1c-cc40-45e0-9309-e500c1798411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:26.384390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757f1c-cc40-45e0-9309-e500c1798411 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:26.384672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757f1c-cc40-45e0-9309-e500c1798411 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:26.384971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6757f1c-cc40-45e0-9309-e500c1798411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:26.385820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6757f1c-cc40-45e0-9309-e500c1798411 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7ff5cd6d70d8421f8fa606bc48dfda24, user.id=cad3b0ff278040fabd6869fd783df233) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:26.386129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6757f1c-cc40-45e0-9309-e500c1798411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:26.387539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6757f1c-cc40-45e0-9309-e500c1798411 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:26.393628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 590/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:56:26 2022] GET /identity/v3/role_assignments?user.id=cad3b0ff278040fabd6869fd783df233&scope.project.id=7ff5cd6d70d8421f8fa606bc48dfda24&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:28.370040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23302ed-c234-4697-b3a6-c9455a877a0a None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:28.370532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23302ed-c234-4697-b3a6-c9455a877a0a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:28.370532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23302ed-c234-4697-b3a6-c9455a877a0a None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:28.371865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 596/1186] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:28.377709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b86bcf-d211-46e9-b5af-ac0d47c48e75 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:28.378098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b86bcf-d211-46e9-b5af-ac0d47c48e75 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:28.378254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b86bcf-d211-46e9-b5af-ac0d47c48e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:28.395131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-68b86bcf-d211-46e9-b5af-ac0d47c48e75 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:28.396291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-68b86bcf-d211-46e9-b5af-ac0d47c48e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:28.424050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:28.462496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 591/1187] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:28.484671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23302ed-c234-4697-b3a6-c9455a877a0a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:28.583500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23302ed-c234-4697-b3a6-c9455a877a0a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:28.616453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:28.617221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:28.617522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:28.617793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:28.620443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:28.629825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:56:28.637359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:56:28.638437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:56:28.639471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 597/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:56:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:56:28.645212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b86bcf-d211-46e9-b5af-ac0d47c48e75 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:28.745269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b86bcf-d211-46e9-b5af-ac0d47c48e75 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:28.779144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:28.779811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:28.780098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:28.781027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:28.781801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:28.782112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:28.783482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:28.791413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 592/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:28.797823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:28.897528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee4040-e999-44cb-8fe3-028b95226e4b None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:28.929924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:28.930777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:28.931064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:28.931338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] PATH_INFO: `/v3/users/cad3b0ff278040fabd6869fd783df233` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:28.932511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] RBAC: Authorizing `identity:get_user(user_id=cad3b0ff278040fabd6869fd783df233)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:28.933978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:28.935582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 598/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:56:28 2022] GET /identity/v3/users/cad3b0ff278040fabd6869fd783df233 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:28.942082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:28.970858 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:29.041194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20197dea-af61-4371-9904-cb4a2009a0f7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:29.076344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318b6a3-69d7-44dc-93db-5ca6b358e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:29.077841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b6a3-69d7-44dc-93db-5ca6b358e90c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:29.078125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b6a3-69d7-44dc-93db-5ca6b358e90c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:29.078403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318b6a3-69d7-44dc-93db-5ca6b358e90c None admin] PATH_INFO: `/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:29.080415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318b6a3-69d7-44dc-93db-5ca6b358e90c None admin] RBAC: Authorizing `identity:get_project(project_id=7ff5cd6d70d8421f8fa606bc48dfda24)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:29.082404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318b6a3-69d7-44dc-93db-5ca6b358e90c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:29.084140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 593/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:56:28 2022] GET /identity/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:29.090466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:29.152067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:29.190002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f260b42-acec-442b-822a-374a4af07cd5 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:29.222569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccad63-3f5d-46e2-9a2a-86dfc9de9a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:29.223439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccad63-3f5d-46e2-9a2a-86dfc9de9a6c None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:29.223717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccad63-3f5d-46e2-9a2a-86dfc9de9a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:29.223991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccad63-3f5d-46e2-9a2a-86dfc9de9a6c None admin] PATH_INFO: `/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24/users/cad3b0ff278040fabd6869fd783df233/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:29.225949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccad63-3f5d-46e2-9a2a-86dfc9de9a6c None admin] RBAC: Authorizing `identity:create_grant(project_id=7ff5cd6d70d8421f8fa606bc48dfda24, user_id=cad3b0ff278040fabd6869fd783df233, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:29.227362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccad63-3f5d-46e2-9a2a-86dfc9de9a6c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:29.240632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 599/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:56:29 2022] PUT /identity/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24/users/cad3b0ff278040fabd6869fd783df233/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:56:31.345417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8563-c49f-419f-b824-da3da15ba5e3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:31.346004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8563-c49f-419f-b824-da3da15ba5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:31.346004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8563-c49f-419f-b824-da3da15ba5e3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:31.347258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 594/1193] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:56:31.352454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368ac04-7d8b-4852-aea0-e6caf1878f83 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:31.352829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368ac04-7d8b-4852-aea0-e6caf1878f83 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:31.353013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368ac04-7d8b-4852-aea0-e6caf1878f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:31.372847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1368ac04-7d8b-4852-aea0-e6caf1878f83 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:56:31.374356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1368ac04-7d8b-4852-aea0-e6caf1878f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:56:31.439009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 600/1194] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:56:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:56:31.462888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8563-c49f-419f-b824-da3da15ba5e3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:31.558440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:31.566160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8563-c49f-419f-b824-da3da15ba5e3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:31.600581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:31.601289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:31.601600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:31.601876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:31.612318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:56:31.619885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:56:31.620967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:56:31.622213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 595/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:56:31.627287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368ac04-7d8b-4852-aea0-e6caf1878f83 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:31.682100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:31.725822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368ac04-7d8b-4852-aea0-e6caf1878f83 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:31.759074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:31.759726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:31.760004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:31.760274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:31.761007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:31.761302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:31.762687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:31.771589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 601/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:31.778479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:31.879471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a6439-b9db-441b-856f-1121ecec0de2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:31.912945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:31.913820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:31.914102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:31.914378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] PATH_INFO: `/v3/users/cad3b0ff278040fabd6869fd783df233` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:31.915548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] RBAC: Authorizing `identity:get_user(user_id=cad3b0ff278040fabd6869fd783df233)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:31.916976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:31.918617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 596/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 13:56:31 2022] GET /identity/v3/users/cad3b0ff278040fabd6869fd783df233 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:31.925079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:32.026826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5b53-94ef-42f9-b088-2ad13f22d2ce None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:32.042411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:32.067308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:32.068432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:32.068933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:32.069266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:32.144701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:32.146104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:32.242415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 602/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:56:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:56:32.248248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:32.273260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:32.346910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661eda2-b855-4e07-b8cf-b4fc7dcedcb7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:32.380968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72083f1c-16d3-407d-ab23-208279548864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:32.381834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083f1c-16d3-407d-ab23-208279548864 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:32.382110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083f1c-16d3-407d-ab23-208279548864 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:32.382381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72083f1c-16d3-407d-ab23-208279548864 None admin] PATH_INFO: `/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:32.383528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72083f1c-16d3-407d-ab23-208279548864 None admin] RBAC: Authorizing `identity:get_project(project_id=7ff5cd6d70d8421f8fa606bc48dfda24)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:32.385014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72083f1c-16d3-407d-ab23-208279548864 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:32.386705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 597/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 13:56:32 2022] GET /identity/v3/projects/7ff5cd6d70d8421f8fa606bc48dfda24 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:32.393073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:56:32.411099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:32.490756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48606a13-9e58-454e-9ede-6c506e911456 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:56:32.523575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620a150-c3bf-4705-85b6-39d206c532e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:56:32.524209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a150-c3bf-4705-85b6-39d206c532e1 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:56:32.524484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a150-c3bf-4705-85b6-39d206c532e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:56:32.524754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620a150-c3bf-4705-85b6-39d206c532e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:56:32.525596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a150-c3bf-4705-85b6-39d206c532e1 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7ff5cd6d70d8421f8fa606bc48dfda24, user.id=cad3b0ff278040fabd6869fd783df233) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:56:32.525903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a150-c3bf-4705-85b6-39d206c532e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:56:32.527310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620a150-c3bf-4705-85b6-39d206c532e1 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:56:32.534313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 603/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:56:32 2022] GET /identity/v3/role_assignments?user.id=cad3b0ff278040fabd6869fd783df233&scope.project.id=7ff5cd6d70d8421f8fa606bc48dfda24&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:56:42.377036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=54 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:56:42.530992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=60 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:27.938987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171dfaa-4ecd-4d46-8c58-acdaef13ef0e None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:27.939587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171dfaa-4ecd-4d46-8c58-acdaef13ef0e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:27.939587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171dfaa-4ecd-4d46-8c58-acdaef13ef0e None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:27.940910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 598/1201] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:27.947089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5172-587a-45b7-98d4-815f469f10c2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:27.947670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5172-587a-45b7-98d4-815f469f10c2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:27.947994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b5172-587a-45b7-98d4-815f469f10c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:27.973221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-031b5172-587a-45b7-98d4-815f469f10c2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:27.973221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-031b5172-587a-45b7-98d4-815f469f10c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:28.059669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 604/1202] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:57:28.084810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171dfaa-4ecd-4d46-8c58-acdaef13ef0e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:28.218184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171dfaa-4ecd-4d46-8c58-acdaef13ef0e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:28.260117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:28.261156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:28.261475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:28.261850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:28.274109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:28.276659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:28.297630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:28.298815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:28.300018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:28.300018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:28.300018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:28.300018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:28.300018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 599/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:28.305366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5172-587a-45b7-98d4-815f469f10c2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:28.433333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031b5172-587a-45b7-98d4-815f469f10c2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:28.477067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:28.488275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38802f-7edf-42fe-aad7-b8d4d57e6ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:28.488966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38802f-7edf-42fe-aad7-b8d4d57e6ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:28.489247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38802f-7edf-42fe-aad7-b8d4d57e6ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:28.489557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38802f-7edf-42fe-aad7-b8d4d57e6ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:28.490389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38802f-7edf-42fe-aad7-b8d4d57e6ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:28.490754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38802f-7edf-42fe-aad7-b8d4d57e6ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:28.492391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38802f-7edf-42fe-aad7-b8d4d57e6ab2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:28.505982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 605/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:28.512384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:28.579869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:28.640388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9d11d-44cb-4681-8c15-608c10d6c438 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:28.679622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64cc09-4661-45e6-8d77-7f1e12dbdd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:28.680333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64cc09-4661-45e6-8d77-7f1e12dbdd68 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:28.681219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64cc09-4661-45e6-8d77-7f1e12dbdd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:28.681617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64cc09-4661-45e6-8d77-7f1e12dbdd68 None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:28.682316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64cc09-4661-45e6-8d77-7f1e12dbdd68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:28.683754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64cc09-4661-45e6-8d77-7f1e12dbdd68 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:28.708286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 600/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 13:57:28 2022] POST /identity/v3/users => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:57:31.072159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d564b-4867-4c9f-aecf-6e9d1aed86f5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:31.072724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d564b-4867-4c9f-aecf-6e9d1aed86f5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:31.072724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d564b-4867-4c9f-aecf-6e9d1aed86f5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:31.074119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 606/1206] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:31.082002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea085c7-8e7d-4819-ba49-3188e697bb97 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:31.082650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea085c7-8e7d-4819-ba49-3188e697bb97 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:31.082650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea085c7-8e7d-4819-ba49-3188e697bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:31.110705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-eea085c7-8e7d-4819-ba49-3188e697bb97 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:31.111932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eea085c7-8e7d-4819-ba49-3188e697bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:31.193380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 601/1207] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:57:31.216378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d564b-4867-4c9f-aecf-6e9d1aed86f5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:31.353104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d564b-4867-4c9f-aecf-6e9d1aed86f5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:31.405994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:31.406899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:31.407180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:31.407486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:31.420104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:57:31.427944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:31.429204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:31.430300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 607/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:57:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:31.437700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea085c7-8e7d-4819-ba49-3188e697bb97 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:31.481929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:31.576230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea085c7-8e7d-4819-ba49-3188e697bb97 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:31.625820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:31.626418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:31.626699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:31.626971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:31.627734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:31.628035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:31.629562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:31.641553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 602/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:57:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:31.648302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:31.719601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:31.787635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855f142-6fc8-4042-b2c3-b978f4fa6d1a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:31.850008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:31.850759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:31.851042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:31.851318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:31.864487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:31.866125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:31.888689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:31.890140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:31.892948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:31.892948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:31.892948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:31.892948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:31.892948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 608/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:31.898632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:32.042654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:32.047367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846db78-59ee-4090-a02a-19ad5de23c3d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:32.097641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:32.098328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:32.098613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:32.098892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:32.099632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:32.099941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:32.101320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:32.117312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 603/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:32.125645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:32.264523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2025d-653e-4544-8212-e07d7a161385 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:32.266945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:32.315645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:32.316616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:32.316858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:32.317159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:32.327342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:32.328831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:57:32.357946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:32.359514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:32.365482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 609/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:32.366244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:32.528129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bce60-2baa-4356-89d9-efb226910eae None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:32.569420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:32.570052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:32.570457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:32.570697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:32.572519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:32.572763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:32.574352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:32.600844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 604/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 13:57:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:32.607469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:32.722351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1276-1946-43b3-908f-0f1582a6738d None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:32.775800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:32.776652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:32.777052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:32.777532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:32.820216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:32.880862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:32.882506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:33.021471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 610/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:57:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:57:33.023130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:33.045267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:33.151914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813bc7f-acaf-436e-8670-d0be5b136b0b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:33.190286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:33.191339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:33.191829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:33.192542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:33.205110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:33.206972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:33.229202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:33.230360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:33.231556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:33.231556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:33.231556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:33.231556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:33.237924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 605/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:33.239481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:33.309702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:33.361719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4c928-1e04-4d9c-bd04-256f927905be None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:33.402762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:33.403694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:33.404077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:33.404500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:33.405385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:33.405856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:33.407370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:33.421602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 611/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:33.427459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:33.512566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:33.552053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958ca5f-d32e-40ad-9049-0d6fbe8702c6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:33.588776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:33.589706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:33.589896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:33.590190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:33.597444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:33.598884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:57:33.614131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:33.615675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:33.616595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:33.622078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 606/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:33.622250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:33.734725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3481822-80e2-4e30-82c9-d56288404d5f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:33.759749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:33.774409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ae18-d100-41d7-a49c-611a859a029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:33.775152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ae18-d100-41d7-a49c-611a859a029b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:33.775437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ae18-d100-41d7-a49c-611a859a029b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:33.775807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ae18-d100-41d7-a49c-611a859a029b None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:33.776933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ae18-d100-41d7-a49c-611a859a029b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:33.777255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ae18-d100-41d7-a49c-611a859a029b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:33.779211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ae18-d100-41d7-a49c-611a859a029b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:33.800619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 612/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:33.801946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:33.938084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709e748-bfa1-41b8-9824-c423eb7dadb0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:33.976928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:33.984266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5867bea-b511-49d1-92b9-dd8ae58287f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:33.985297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5867bea-b511-49d1-92b9-dd8ae58287f7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:33.985451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5867bea-b511-49d1-92b9-dd8ae58287f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:33.985790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5867bea-b511-49d1-92b9-dd8ae58287f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:33.986807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5867bea-b511-49d1-92b9-dd8ae58287f7 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=ecddc5e9b4e140ff817284acb38d9801) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:33.987148 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5867bea-b511-49d1-92b9-dd8ae58287f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:33.988723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5867bea-b511-49d1-92b9-dd8ae58287f7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:34.005383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 607/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:57:33 2022] GET /identity/v3/role_assignments?user.id=ecddc5e9b4e140ff817284acb38d9801&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:36.091600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48eeb8-f1c2-4907-a93a-a6a2975faf42 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:36.091600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48eeb8-f1c2-4907-a93a-a6a2975faf42 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:36.092070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48eeb8-f1c2-4907-a93a-a6a2975faf42 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:36.093440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 613/1220] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:36.098818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4acdc-8a08-4808-b29e-27982eaf753c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:36.099345 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4acdc-8a08-4808-b29e-27982eaf753c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:36.099478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4acdc-8a08-4808-b29e-27982eaf753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:36.117376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fca4acdc-8a08-4808-b29e-27982eaf753c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:36.118938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fca4acdc-8a08-4808-b29e-27982eaf753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:36.189724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 608/1221] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:57:36.214332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48eeb8-f1c2-4907-a93a-a6a2975faf42 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:36.328953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48eeb8-f1c2-4907-a93a-a6a2975faf42 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:36.364373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:36.365096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:36.365403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:36.365681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:36.376511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:57:36.385073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:36.386414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:36.387784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 614/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:57:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:36.392636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4acdc-8a08-4808-b29e-27982eaf753c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:36.503033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4acdc-8a08-4808-b29e-27982eaf753c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:36.528972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:36.539919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:36.540588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:36.540871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:36.541177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:36.541955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] RBAC: Adding query filter params (name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:36.542270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:36.543861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:36.552327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 609/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:57:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:36.558754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:36.605241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:36.666328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc87be-cadc-437f-bee5-e4417eac53a9 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:36.707239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:36.708372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:36.708786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:36.709184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:36.723601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:36.725894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:36.746981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:36.747949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:36.748855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:36.748855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:36.748855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:36.748855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:36.748855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 615/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:36.754248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:36.863973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdb6b-4585-4e06-b5f1-ebcd6b14122b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:36.901480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:36.902193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:36.902520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:36.902883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:36.903624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:36.903940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:36.905309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:36.918943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 610/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:36.924983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:37.033749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:37.041626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507acfc0-45a3-4320-9ae4-d475a1b8ef6e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:37.079657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:37.080486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:37.080812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:37.081100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:37.091900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:37.093369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:57:37.110281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:37.111305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:37.113060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 616/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:37.118161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:37.174433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:37.237069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249a7e7-8d2e-4f15-8c86-106297c80e94 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:37.283702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:37.284588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:37.285009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:37.285460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:37.286445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:37.286943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:37.288635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:37.308395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 611/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 13:57:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:37.314592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:37.429362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27084-bc37-43c1-8043-8c4953336767 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:37.473153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:37.474097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:37.474393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:37.474648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:37.487582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:37.489128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:37.511874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:37.513304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:37.514425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:37.514425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:37.514425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:37.514425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:37.514425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 617/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:37.519256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:37.638625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a947d0-ebaa-4152-b997-1e360f86a3ef None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:37.641035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:37.674495 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:37.675162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:37.675445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:37.675721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:37.676443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:37.676794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:37.678195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:37.690582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 612/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:37.697509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:37.707457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:37.804448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b297372-f3d4-4583-8641-e8aa910c3be2 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:37.844123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:37.844910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:37.845190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:37.845494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:37.852990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:37.854479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:57:37.869801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:37.871618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:37.873544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 618/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:37.877146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:37.994761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bf19c-af76-4dcb-bbaa-08a5afe26472 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:38.039064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4e9ee-0fd3-4c57-9881-066b1a2d06c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:38.040550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e9ee-0fd3-4c57-9881-066b1a2d06c5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:38.040921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e9ee-0fd3-4c57-9881-066b1a2d06c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:38.041446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4e9ee-0fd3-4c57-9881-066b1a2d06c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:38.042882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e9ee-0fd3-4c57-9881-066b1a2d06c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:38.043435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e9ee-0fd3-4c57-9881-066b1a2d06c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:38.046080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4e9ee-0fd3-4c57-9881-066b1a2d06c5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:38.071307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 613/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:57:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:38.073213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:38.152257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:38.188460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5f437-50f1-438a-9a86-9622e28ad526 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:38.226336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abc0e5-87f5-4be5-b691-94e855c1148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:38.227743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc0e5-87f5-4be5-b691-94e855c1148f None admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:38.228018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc0e5-87f5-4be5-b691-94e855c1148f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:38.228368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abc0e5-87f5-4be5-b691-94e855c1148f None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/ecddc5e9b4e140ff817284acb38d9801/roles/17da537249e74814b7c89c0c614f5da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:38.245056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc0e5-87f5-4be5-b691-94e855c1148f None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=ecddc5e9b4e140ff817284acb38d9801, role_id=17da537249e74814b7c89c0c614f5da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:38.246567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abc0e5-87f5-4be5-b691-94e855c1148f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:38.261575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 619/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:57:38 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/ecddc5e9b4e140ff817284acb38d9801/roles/17da537249e74814b7c89c0c614f5da3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:57:40.315190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f5d7-ad22-47eb-a53d-9d40ecff843a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:40.315765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f5d7-ad22-47eb-a53d-9d40ecff843a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:40.315765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1f5d7-ad22-47eb-a53d-9d40ecff843a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:40.317581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 614/1233] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:40.324402 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020fe35-04a4-4a93-9044-7791bd7cdacd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:40.324950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020fe35-04a4-4a93-9044-7791bd7cdacd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:40.325049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020fe35-04a4-4a93-9044-7791bd7cdacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:40.344536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6020fe35-04a4-4a93-9044-7791bd7cdacd None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:40.345791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6020fe35-04a4-4a93-9044-7791bd7cdacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:40.421770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 620/1234] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:57:40.447708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f5d7-ad22-47eb-a53d-9d40ecff843a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:40.477220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:40.563788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1f5d7-ad22-47eb-a53d-9d40ecff843a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:40.602206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:40.603024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:40.603313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:40.603594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:40.613997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:57:40.622356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:40.623673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:40.624686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 615/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 13:57:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:40.632322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020fe35-04a4-4a93-9044-7791bd7cdacd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:40.682222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:40.739048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020fe35-04a4-4a93-9044-7791bd7cdacd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:40.775827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:40.776494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:40.776770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:40.777045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:40.778004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] RBAC: Adding query filter params (name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:40.778353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:40.779783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:40.789419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 621/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 13:57:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:40.795156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:40.895834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:40.913908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b80c-cd67-44b1-8f97-34de7e1f9305 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:40.954135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:40.955945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:40.956202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:40.956473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:40.968487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:40.970045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:40.987487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:40.988602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:40.989700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:40.989700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:40.989700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:40.989700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:40.989700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 616/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:40.995235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:41.103887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82258c3f-a077-43e8-813e-af8292ea878f None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:41.114294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:41.142172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:41.143088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:41.143356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:41.143629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:41.144358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:41.144696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:41.146165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:41.158391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 622/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:41.165366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:41.276672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafa125-a1b1-4a61-9dca-f2bbe90b4dcc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:41.313135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:41.313992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:41.314272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:41.314544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:41.320070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:41.326428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:41.328007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:57:41.345295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:41.346463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:41.348166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 617/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:41.353016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:41.468138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24929e2-46b3-4a42-b044-d2777c03a74c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:41.509593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:41.510267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:41.510550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:41.510825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:41.511668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:41.511976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:41.513449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:41.532026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 623/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 13:57:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:41.538142 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:41.648583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd8508-a0ac-43de-bc6b-90c59d6d5def None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:41.688374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:41.689069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:41.689396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:41.689789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:41.765323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:41.773072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:41.774766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:41.899762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 618/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:57:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:57:41.906641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:41.939905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:42.027143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33563d49-8717-4752-b4a4-65bf3a464191 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:42.065044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:42.065970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:42.066296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:42.066887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:42.079026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:42.080585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:42.100812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:42.102115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:42.108101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:42.108101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:42.108101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:42.108101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:42.108101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 624/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:57:42.108455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:42.210278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:42.218242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6528b9-42d7-43eb-b088-c8b8e5cea5e0 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:42.259059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:42.259743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:42.260023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:42.260305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:42.261133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:42.261491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:42.263041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:42.277848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 619/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:42.283937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:42.377742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:42.404867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee318a8-70a6-4644-ae4a-f74e50e4483e None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:42.446744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:42.447679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:42.448093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:42.448358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:42.456593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:42.458065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:57:42.474183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:42.475430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:42.476439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 625/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:42.481917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:42.592471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366f8e-a16b-42b7-a701-e7bde388376b None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:42.628412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261511b9-685c-4eee-b3bb-07f7d4387c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:42.629907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261511b9-685c-4eee-b3bb-07f7d4387c2f None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:42.630215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261511b9-685c-4eee-b3bb-07f7d4387c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:42.630494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261511b9-685c-4eee-b3bb-07f7d4387c2f None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:42.631298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261511b9-685c-4eee-b3bb-07f7d4387c2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:42.631607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261511b9-685c-4eee-b3bb-07f7d4387c2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:42.634249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261511b9-685c-4eee-b3bb-07f7d4387c2f None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:42.647739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 620/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:42.655292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:42.775047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b3fc-8d56-45c4-9736-904a56b58313 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:42.815179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1298b45-ecad-421b-adeb-2ccc346961a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:42.815989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298b45-ecad-421b-adeb-2ccc346961a7 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:42.816307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298b45-ecad-421b-adeb-2ccc346961a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:42.816888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298b45-ecad-421b-adeb-2ccc346961a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:42.817938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1298b45-ecad-421b-adeb-2ccc346961a7 None admin] RBAC: Adding query filter params (role.id=17da537249e74814b7c89c0c614f5da3, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=ecddc5e9b4e140ff817284acb38d9801) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:42.818279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1298b45-ecad-421b-adeb-2ccc346961a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:42.820049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1298b45-ecad-421b-adeb-2ccc346961a7 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:42.827233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 626/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:57:42 2022] GET /identity/v3/role_assignments?user.id=ecddc5e9b4e140ff817284acb38d9801&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=17da537249e74814b7c89c0c614f5da3 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:45.033295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d57346-c276-4e21-8d78-abb475767474 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:45.033913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d57346-c276-4e21-8d78-abb475767474 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:45.034007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d57346-c276-4e21-8d78-abb475767474 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:45.035462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 621/1247] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:45.042122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131e12-b665-4a56-baeb-8abf199f424b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:45.042553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131e12-b665-4a56-baeb-8abf199f424b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:45.042681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131e12-b665-4a56-baeb-8abf199f424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:45.048222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:45.062416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-02131e12-b665-4a56-baeb-8abf199f424b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:45.063624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-02131e12-b665-4a56-baeb-8abf199f424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:45.142388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 627/1248] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 13:57:45.168974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d57346-c276-4e21-8d78-abb475767474 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:45.192247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:45.287449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d57346-c276-4e21-8d78-abb475767474 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:45.329004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:45.329897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:45.330192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:45.330505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:45.343094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:57:45.352713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:45.353903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:45.360002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 622/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 13:57:45.360954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02131e12-b665-4a56-baeb-8abf199f424b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:45.483945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02131e12-b665-4a56-baeb-8abf199f424b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:45.518333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:45.525089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:45.525835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:45.526095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:45.526372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:45.527132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:45.527439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:45.528824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:45.538825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 628/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:45.544756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:45.633237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:45.659570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc2bc7-895f-4dda-86a5-69763568196c None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:45.701791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:45.702592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:45.702871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:45.703143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:45.717227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:45.719343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:45.738648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:45.745973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:45.747282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:45.747282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:45.747282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:45.747282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:45.747282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 623/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:45.747860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:45.874312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337ab4-dade-4978-8588-78ea23b3a3ea None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:45.911837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:45.912508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:45.912795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:45.913076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:45.914702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:45.915056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:45.916481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:45.928697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 629/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:45.935430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:46.049803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27919490-41be-4247-af0f-003b3cb119e5 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:46.083512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:46.093292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:46.094094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:46.094384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:46.094661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:46.103229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:46.105132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:57:46.120694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:46.121736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:46.122696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 624/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:46.129283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:46.185510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:46.233334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320637c-1786-4f82-a3ee-3ddf81d1e2a4 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:46.277334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:46.278042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:46.278363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:46.278608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:46.279449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:46.279762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:46.281226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:46.299486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 630/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 13:57:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:46.305951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:46.430201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acfb23-57dd-40e7-a252-1cddcbf174d2 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:46.466859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:46.467527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:46.467837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:46.468165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:46.536521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:46.550268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:46.551740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:46.655950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 625/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:57:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:57:46.661927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:46.774982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6f08e-021b-4f9f-9664-035a959c8661 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:46.790472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:46.813570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:46.814410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:46.814824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:46.815032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:46.826815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:46.828862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:46.861207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:46.862361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:46.863653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:46.863653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:46.863653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:46.863653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:46.863653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 631/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:46.870591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:46.983718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:46.998320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96afc1a-9011-4635-add5-152899db1aa7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:47.033788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:47.034329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:47.034612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:47.034888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:47.035610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:47.035934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:47.037295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:47.050604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 626/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:47.056776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:47.175593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8056967-d4ce-4ee2-848d-4a93ad8a4f50 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:47.215800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:47.216692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:47.217035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:47.217321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:47.225452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:47.227290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:57:47.243267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:47.244370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:47.245506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 632/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:57:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:47.250836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:47.364132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e6d5-dc4a-4e1b-8a2d-bf26a9a8495d None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:47.401318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583e27-1b1a-4347-8367-fbca0bdf15e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:47.402021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583e27-1b1a-4347-8367-fbca0bdf15e8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:47.402305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583e27-1b1a-4347-8367-fbca0bdf15e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:47.402584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583e27-1b1a-4347-8367-fbca0bdf15e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:47.403376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583e27-1b1a-4347-8367-fbca0bdf15e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:47.403687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583e27-1b1a-4347-8367-fbca0bdf15e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:47.405132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583e27-1b1a-4347-8367-fbca0bdf15e8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:47.421088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 627/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:57:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:47.427157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:47.455243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:47.543436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd724066-dbaa-45d7-a93a-d84ec1512d79 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:47.582045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf13cb-c515-4dc5-8afb-1190c3182379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:47.583214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf13cb-c515-4dc5-8afb-1190c3182379 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:47.583532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf13cb-c515-4dc5-8afb-1190c3182379 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:47.583815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf13cb-c515-4dc5-8afb-1190c3182379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:47.584682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf13cb-c515-4dc5-8afb-1190c3182379 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=ecddc5e9b4e140ff817284acb38d9801) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:47.585633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf13cb-c515-4dc5-8afb-1190c3182379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:47.587184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf13cb-c515-4dc5-8afb-1190c3182379 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:47.594039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 633/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:57:47 2022] GET /identity/v3/role_assignments?user.id=ecddc5e9b4e140ff817284acb38d9801&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=12c8bb015e454a52a54bf61032d11091 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:49.609015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2429b56-1fc6-47aa-adc5-a562144224b1 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:49.609579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2429b56-1fc6-47aa-adc5-a562144224b1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:49.609704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2429b56-1fc6-47aa-adc5-a562144224b1 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:49.610989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 628/1261] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:49.616001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f616-f30d-4b7f-af1a-a00dd8db5db3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:49.616438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f616-f30d-4b7f-af1a-a00dd8db5db3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:49.616622 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f616-f30d-4b7f-af1a-a00dd8db5db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:49.633705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3112f616-f30d-4b7f-af1a-a00dd8db5db3 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:49.634889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3112f616-f30d-4b7f-af1a-a00dd8db5db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:49.699859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 634/1262] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:57:49.722919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2429b56-1fc6-47aa-adc5-a562144224b1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:49.733896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:49.828383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2429b56-1fc6-47aa-adc5-a562144224b1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:49.871654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:49.872483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:49.872874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:49.873245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:49.887017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:57:49.895175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:49.896293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:49.898129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 629/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:49.903338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f616-f30d-4b7f-af1a-a00dd8db5db3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:49.922064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:50.001666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f616-f30d-4b7f-af1a-a00dd8db5db3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:50.038934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:50.041695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:50.041695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:50.041695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:50.041695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:50.041695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:50.044101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:50.050582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 635/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:50.056646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:50.123856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:50.159019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f20ee-1fe0-4ccd-bfb9-6e7a8cc7cc09 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:50.192762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:50.193572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:50.193852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:50.194216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:50.204372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:50.205879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:50.222210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:50.223113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:50.224071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:50.224071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:50.224071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:50.224071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:50.224071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 630/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:50.229901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:50.311288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:50.330267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f3e4a-566a-417d-9316-a02be01fb054 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:50.363194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:50.363847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:50.364129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:50.364405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:50.365120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:50.365455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:50.367518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:50.384303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 636/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:50.390110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:50.496706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ae395-04d2-4c2c-8614-acde2abe9bab None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:50.515653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:50.530694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:50.531491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:50.531771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:50.532045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:50.539679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:50.541114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:57:50.556189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:50.557286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:50.558274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 631/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:50.563561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:50.662178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadaed5-ceb7-4262-8eeb-832f1199b11c None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:50.697226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:50.697907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:50.698189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:50.698461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:50.699286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:50.699590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:50.700994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:50.709366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:50.719309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 637/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 13:57:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:50.725369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:50.829985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced82f6-346b-4e51-89d2-a843b6fe15d8 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:50.868884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:50.869691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:50.869975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:50.870253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:50.880469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:50.882620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:50.899489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:50.900547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:50.901665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:50.901665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:50.901665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:50.901665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:50.901665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 632/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:50.906846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:51.007297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52062d2-a8b1-44b9-a85d-f40f7e4522f3 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:51.045393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:51.045393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:51.045703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:51.045942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:51.046598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:51.046908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:51.048271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:51.061074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 638/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:51.066878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:51.099477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:51.169091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cbdfd-cd62-4b9d-986d-3268f5df8b22 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:51.203225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:51.204015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:51.204293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:51.204566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:51.211837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:51.213261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:57:51.227480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:51.228543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:51.229488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 633/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:57:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:51.234779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:51.293099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:51.335709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1c597-64c4-4bb3-b0a7-b55e71aaa644 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:51.368395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c060a16-cc51-48cd-98b0-fa036e6a5e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:51.369040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060a16-cc51-48cd-98b0-fa036e6a5e0e None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:51.369325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060a16-cc51-48cd-98b0-fa036e6a5e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:51.369634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060a16-cc51-48cd-98b0-fa036e6a5e0e None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:51.370410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c060a16-cc51-48cd-98b0-fa036e6a5e0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:51.370719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c060a16-cc51-48cd-98b0-fa036e6a5e0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:51.372133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c060a16-cc51-48cd-98b0-fa036e6a5e0e None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:51.384312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 639/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:51.390228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:51.482018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:51.491448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d6542-1622-4b16-a60e-785a389a1527 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:51.525029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa2bf9-17fe-4b2f-898c-8839cb616ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:51.526408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa2bf9-17fe-4b2f-898c-8839cb616ea1 None admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:51.526408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa2bf9-17fe-4b2f-898c-8839cb616ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:51.526626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa2bf9-17fe-4b2f-898c-8839cb616ea1 None admin] PATH_INFO: `/v3/projects/7577656601f14550ab40539deaaa67e1/users/ecddc5e9b4e140ff817284acb38d9801/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:51.528528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa2bf9-17fe-4b2f-898c-8839cb616ea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7577656601f14550ab40539deaaa67e1, user_id=ecddc5e9b4e140ff817284acb38d9801, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:51.529997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa2bf9-17fe-4b2f-898c-8839cb616ea1 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:51.542936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 634/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 13:57:51 2022] PUT /identity/v3/projects/7577656601f14550ab40539deaaa67e1/users/ecddc5e9b4e140ff817284acb38d9801/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 13:57:53.539852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ba9d0-b17b-4d93-b6b9-9591c8a5b647 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:53.540418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ba9d0-b17b-4d93-b6b9-9591c8a5b647 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:53.540418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ba9d0-b17b-4d93-b6b9-9591c8a5b647 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:53.541799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 640/1274] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:53.546885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846119d8-fd5b-4eb6-919e-aa0fcc604ba0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:53.547339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846119d8-fd5b-4eb6-919e-aa0fcc604ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:53.547439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846119d8-fd5b-4eb6-919e-aa0fcc604ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:53.564517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-846119d8-fd5b-4eb6-919e-aa0fcc604ba0 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:53.566001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-846119d8-fd5b-4eb6-919e-aa0fcc604ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:53.632804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 635/1275] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:57:53.655657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ba9d0-b17b-4d93-b6b9-9591c8a5b647 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:53.755700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ba9d0-b17b-4d93-b6b9-9591c8a5b647 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:53.772867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:53.789532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:53.790357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:53.790592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:53.790871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:53.800643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 13:57:53.808942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:53.809974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:53.811145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 641/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 13:57:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:53.816434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846119d8-fd5b-4eb6-919e-aa0fcc604ba0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:53.902507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:53.921394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846119d8-fd5b-4eb6-919e-aa0fcc604ba0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:53.954748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:53.955409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:53.955685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:53.955952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:53.956689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:53.956991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:53.958392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:53.966279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 636/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 13:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:53.972053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:54.071161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b9c95-83e2-4ba0-910b-07a7afae14f0 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:54.103970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:54.104758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:54.105039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:54.105316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:54.116187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:54.117737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:54.134389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:54.135303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:54.136218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:54.136218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:54.136218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:54.136218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:54.136218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 642/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:54.141264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:54.243983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0955b9-28b1-46a6-a7ef-fb56ea848498 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:54.277256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:54.277934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:54.278217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:54.278494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:54.279357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:54.279661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:54.281024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:54.293476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 637/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:54.299055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:54.329428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:54.399821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a356dd8-c477-45d5-974e-33720c118932 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:54.431895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:54.432678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:54.432956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:54.433228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:54.440284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:54.442001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 13:57:54.455660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:54.456662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:54.457688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 643/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:54.463146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:54.467485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:54.561848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a90a0-9508-45e5-9731-8c324c9956c9 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:54.594477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:54.595066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:54.595342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:54.595609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:54.596427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:54.596733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:54.598167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:54.615194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 638/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 13:57:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:54.620897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:54.710151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:54.722660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53051f3-edf6-486f-8a9d-6996e4e2f035 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:54.755950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:54.756703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:54.756981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:54.757619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:54.824557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:54.826039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:54.913663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:54.924168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 644/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 13:57:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 13:57:54.930579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:54.991855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:55.030359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c525fdd-28c3-49b0-9791-2ced417f6eab None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:55.063516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:55.064288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:55.064572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:55.064848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:55.075230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:55.076683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 13:57:55.094927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:55.095976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:55.096941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 13:57:55.096941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 13:57:55.096941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 13:57:55.096941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:55.096941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 639/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 13:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:55.102825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:55.198963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360612a8-1262-4ac4-a1b2-0b67ae968d14 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:55.232969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:55.233649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:55.233933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:55.234208 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:55.234916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:55.235221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:55.236574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:55.247615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 645/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 13:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:55.253095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:55.350629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dce2a-a616-4ce8-9ece-d4f1aeea39fc None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:55.363960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:55.383981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:55.384755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:55.385032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:55.385302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:55.391722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:55.393136 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 13:57:55.406571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:55.407636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: ERROR keystone.server.flask.application Jul 18 13:57:55.408917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 640/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 13:57:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:55.414118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:55.464262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:55.513054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d21a-a939-4db5-98ae-55cb651b6616 None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:55.545233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f346c-01b0-4433-8301-30bbd3aa4b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:55.545907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f346c-01b0-4433-8301-30bbd3aa4b79 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:55.546189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f346c-01b0-4433-8301-30bbd3aa4b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:55.546463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f346c-01b0-4433-8301-30bbd3aa4b79 None admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:55.547262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f346c-01b0-4433-8301-30bbd3aa4b79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:55.547565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f346c-01b0-4433-8301-30bbd3aa4b79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:55.548969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f346c-01b0-4433-8301-30bbd3aa4b79 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:55.560550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 646/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 13:57:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 13:57:55.566781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:55.666691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec98de6-fd44-4841-a283-28a5aec194f6 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:55.699711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584fca2-61ef-43ab-9004-50d5846778f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:55.700353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584fca2-61ef-43ab-9004-50d5846778f8 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:55.700636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584fca2-61ef-43ab-9004-50d5846778f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:55.700914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584fca2-61ef-43ab-9004-50d5846778f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:55.701763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584fca2-61ef-43ab-9004-50d5846778f8 None admin] RBAC: Adding query filter params (role.id=12c8bb015e454a52a54bf61032d11091, scope.project.id=7577656601f14550ab40539deaaa67e1, user.id=ecddc5e9b4e140ff817284acb38d9801) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:55.702072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584fca2-61ef-43ab-9004-50d5846778f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:55.703490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584fca2-61ef-43ab-9004-50d5846778f8 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:55.709706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 641/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 13:57:55 2022] GET /identity/v3/role_assignments?user.id=ecddc5e9b4e140ff817284acb38d9801&scope.project.id=7577656601f14550ab40539deaaa67e1&role.id=12c8bb015e454a52a54bf61032d11091 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:57.740145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744bdbb-dc40-43af-abb4-d9284bb68fea None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:57.740746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744bdbb-dc40-43af-abb4-d9284bb68fea None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:57.740746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744bdbb-dc40-43af-abb4-d9284bb68fea None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:57.742125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 647/1288] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:57:57.747298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac09aef-eb10-4f87-a19f-dd120d49f96f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:57.747734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac09aef-eb10-4f87-a19f-dd120d49f96f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:57.747836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac09aef-eb10-4f87-a19f-dd120d49f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:57.764981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bac09aef-eb10-4f87-a19f-dd120d49f96f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:57:57.766210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bac09aef-eb10-4f87-a19f-dd120d49f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:57:57.795663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:57.838596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 642/1289] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:57:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:57:57.860896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744bdbb-dc40-43af-abb4-d9284bb68fea None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:57.965525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744bdbb-dc40-43af-abb4-d9284bb68fea None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:57.975935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:57:58.000213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:58.000930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:58.001215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:58.001522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:58.002168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:58.003530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:57:58.016109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:57:58.017334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:57:58.018705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 648/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:57:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:57:58.024012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac09aef-eb10-4f87-a19f-dd120d49f96f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:58.130018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac09aef-eb10-4f87-a19f-dd120d49f96f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:58.163412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b15850-6b9e-4fe3-9d02-cd131ff40fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:58.164068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15850-6b9e-4fe3-9d02-cd131ff40fff None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:58.164352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15850-6b9e-4fe3-9d02-cd131ff40fff None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:58.164628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15850-6b9e-4fe3-9d02-cd131ff40fff None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:58.165330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b15850-6b9e-4fe3-9d02-cd131ff40fff None admin] RBAC: Adding query filter params (name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:58.165669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b15850-6b9e-4fe3-9d02-cd131ff40fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:58.167035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b15850-6b9e-4fe3-9d02-cd131ff40fff None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:58.171792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 643/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 13:57:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:57:58.177544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:57:58.276920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbae7ff-9675-4944-92a6-915f20353f0a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:57:58.310282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8753c3-ae39-4ea4-bff6-bb189f5edc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:57:58.310931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8753c3-ae39-4ea4-bff6-bb189f5edc9b None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:57:58.311218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8753c3-ae39-4ea4-bff6-bb189f5edc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:57:58.311510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8753c3-ae39-4ea4-bff6-bb189f5edc9b None admin] PATH_INFO: `/v3/services` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:57:58.312206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8753c3-ae39-4ea4-bff6-bb189f5edc9b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:57:58.312510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8753c3-ae39-4ea4-bff6-bb189f5edc9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:57:58.313897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8753c3-ae39-4ea4-bff6-bb189f5edc9b None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:57:58.319129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 649/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 13:57:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:58:00.330332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d936-f5f0-467f-93ca-0a19473a6212 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:00.330851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d936-f5f0-467f-93ca-0a19473a6212 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:00.330961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d936-f5f0-467f-93ca-0a19473a6212 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:00.332272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 644/1293] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:58:00.337735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ce6dd-eb62-41f6-a75c-f89d89c2f34d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:00.338233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ce6dd-eb62-41f6-a75c-f89d89c2f34d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:00.338318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ce6dd-eb62-41f6-a75c-f89d89c2f34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:00.354962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-550ce6dd-eb62-41f6-a75c-f89d89c2f34d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:58:00.356106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-550ce6dd-eb62-41f6-a75c-f89d89c2f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:58:00.386570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:00.423066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 650/1294] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:58:00.446477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44d936-f5f0-467f-93ca-0a19473a6212 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:00.477181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:00.548645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44d936-f5f0-467f-93ca-0a19473a6212 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:00.582354 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c7562-ceef-44e1-ac54-ed8c0ea266d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:00.583008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c7562-ceef-44e1-ac54-ed8c0ea266d7 None admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:00.583293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c7562-ceef-44e1-ac54-ed8c0ea266d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:00.583599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c7562-ceef-44e1-ac54-ed8c0ea266d7 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:00.584609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c7562-ceef-44e1-ac54-ed8c0ea266d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:00.586011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c7562-ceef-44e1-ac54-ed8c0ea266d7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:00.598640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 645/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 13:58:00 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:58:02.634743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07ada-dfb4-4faa-8dd5-290764039338 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:02.635306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07ada-dfb4-4faa-8dd5-290764039338 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:02.635306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07ada-dfb4-4faa-8dd5-290764039338 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:02.636673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 651/1296] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:58:02.641905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bf66-62bd-4722-a4a4-0fd6eaed2fc1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:02.642292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bf66-62bd-4722-a4a4-0fd6eaed2fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:02.642474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9bf66-62bd-4722-a4a4-0fd6eaed2fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:02.659206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fcc9bf66-62bd-4722-a4a4-0fd6eaed2fc1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:58:02.660391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fcc9bf66-62bd-4722-a4a4-0fd6eaed2fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:58:02.732095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 646/1297] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:58:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:58:02.755006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07ada-dfb4-4faa-8dd5-290764039338 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:02.865332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07ada-dfb4-4faa-8dd5-290764039338 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:02.903934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:02.904649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:02.904933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:02.905210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:02.905893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:02.907262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:58:02.919595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:58:02.920750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:58:02.921879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 652/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:58:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:58:02.926749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9bf66-62bd-4722-a4a4-0fd6eaed2fc1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:02.946279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:03.027533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9bf66-62bd-4722-a4a4-0fd6eaed2fc1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:03.061653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:03.062307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:03.062584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:03.062852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:03.063542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:58:03.063841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:03.065466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:03.070785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 647/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 13:58:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:58:03.077283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:03.109642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:03.179704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba6c80-5311-4ada-a2ec-a9947a039d2a None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:03.212009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f2b52-6c5d-467d-8528-01ecda2503c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:03.212649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2b52-6c5d-467d-8528-01ecda2503c3 None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:03.212927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2b52-6c5d-467d-8528-01ecda2503c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:03.213199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f2b52-6c5d-467d-8528-01ecda2503c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:03.214011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2b52-6c5d-467d-8528-01ecda2503c3 None admin] RBAC: Adding query filter params (interface=public, service_id=bbd4c6c2b1ec4976873df0621c37c814, region_id=RegionOne) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:58:03.214318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2b52-6c5d-467d-8528-01ecda2503c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:03.215665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f2b52-6c5d-467d-8528-01ecda2503c3 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:03.220519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 653/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 13:58:03 2022] GET /identity/v3/endpoints?service_id=bbd4c6c2b1ec4976873df0621c37c814&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:58:03.226702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:03.307128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:03.325370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f491e-50ca-46ac-91db-da19e52150d7 None admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:03.358527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c266d7-26ce-4444-94f5-00636e5db16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:03.359188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c266d7-26ce-4444-94f5-00636e5db16b None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:03.359475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c266d7-26ce-4444-94f5-00636e5db16b None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:03.359754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c266d7-26ce-4444-94f5-00636e5db16b None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:03.360437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c266d7-26ce-4444-94f5-00636e5db16b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:03.361836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c266d7-26ce-4444-94f5-00636e5db16b None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:03.369109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 648/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 13:58:03 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 13:58:05.376216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53167357-6262-414e-9d91-f6a5ec2f27df None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:05.376735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53167357-6262-414e-9d91-f6a5ec2f27df None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:05.376735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53167357-6262-414e-9d91-f6a5ec2f27df None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:05.378089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 654/1302] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:58:05.383916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483d72-9542-4d1e-ac51-cdd57b4e2082 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:05.384345 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483d72-9542-4d1e-ac51-cdd57b4e2082 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:05.384545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483d72-9542-4d1e-ac51-cdd57b4e2082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:05.401652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a8483d72-9542-4d1e-ac51-cdd57b4e2082 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:58:05.402821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a8483d72-9542-4d1e-ac51-cdd57b4e2082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:58:05.469361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 649/1303] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:58:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 13:58:05.491801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53167357-6262-414e-9d91-f6a5ec2f27df None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:05.591172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:05.598088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53167357-6262-414e-9d91-f6a5ec2f27df None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:05.631533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:05.632252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:05.632531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:05.632805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:05.633476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:05.634828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 13:58:05.646391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 13:58:05.647485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application with Lock( Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self._enter() Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application return self.creator() Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application created_value = creator( Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: ERROR keystone.server.flask.application Jul 18 13:58:05.648841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 655/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 13:58:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 13:58:05.653732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483d72-9542-4d1e-ac51-cdd57b4e2082 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:05.727906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:05.750530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483d72-9542-4d1e-ac51-cdd57b4e2082 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:05.783602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42dbe4-defd-4748-8b05-e2afb951ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:05.784252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dbe4-defd-4748-8b05-e2afb951ec2c None admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:05.784531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dbe4-defd-4748-8b05-e2afb951ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:05.784804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dbe4-defd-4748-8b05-e2afb951ec2c None admin] PATH_INFO: `/v3/services` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:05.785534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dbe4-defd-4748-8b05-e2afb951ec2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 13:58:05.785837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dbe4-defd-4748-8b05-e2afb951ec2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:05.787287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dbe4-defd-4748-8b05-e2afb951ec2c None admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:05.792283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 650/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 13:58:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 13:58:05.798018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:58:05.905640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ead6b-60c4-4e3a-9bb9-306e16cacefb None admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:58:05.941702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a9cfa-60b2-41d8-9cfb-53b1b4c2a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:58:05.942362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9cfa-60b2-41d8-9cfb-53b1b4c2a951 None admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:58:05.943467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9cfa-60b2-41d8-9cfb-53b1b4c2a951 None admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:58:05.943467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a9cfa-60b2-41d8-9cfb-53b1b4c2a951 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:58:05.943918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a9cfa-60b2-41d8-9cfb-53b1b4c2a951 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:58:05.945283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a9cfa-60b2-41d8-9cfb-53b1b4c2a951 None admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:58:05.963418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 656/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 13:58:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 13:58:15.789360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=30 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:58:15.959059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:09.318881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b44154-c9d1-45d5-8f61-39b507d36718 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:09.319324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b44154-c9d1-45d5-8f61-39b507d36718 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:09.319528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b44154-c9d1-45d5-8f61-39b507d36718 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:09.325436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 651/1307] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:09.326821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5dc6-56cb-4e48-9340-3ebfe324af55 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:09.327208 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5dc6-56cb-4e48-9340-3ebfe324af55 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:09.327436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e5dc6-56cb-4e48-9340-3ebfe324af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:09.424354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cc6e5dc6-56cb-4e48-9340-3ebfe324af55 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:09.425616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cc6e5dc6-56cb-4e48-9340-3ebfe324af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:09.542696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 657/1308] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:09.598182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4540bc-0ffb-4f3e-984c-f1bf4a2c7147 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:09.598886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4540bc-0ffb-4f3e-984c-f1bf4a2c7147 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:09.599404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4540bc-0ffb-4f3e-984c-f1bf4a2c7147 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:09.601290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 652/1309] 10.222.0.76 () {54 vars in 965 bytes} [Mon Jul 18 13:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:09.607195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44fadf-aad0-450d-abb6-6f393addd070 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:09.608242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44fadf-aad0-450d-abb6-6f393addd070 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:09.608867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44fadf-aad0-450d-abb6-6f393addd070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:09.698255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2b44fadf-aad0-450d-abb6-6f393addd070 None None] MFA Rules not processed for user `2b28926500a14cd3aa74c59f60e076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:09.699500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2b44fadf-aad0-450d-abb6-6f393addd070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:09.723314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:09.782789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 658/1310] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Jul 18 13:59:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 13:59:09.791826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4540bc-0ffb-4f3e-984c-f1bf4a2c7147 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:09.793647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ee4540bc-0ffb-4f3e-984c-f1bf4a2c7147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:09.913519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4540bc-0ffb-4f3e-984c-f1bf4a2c7147 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:09.996039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633d3ce-e0f3-4e37-bc8d-e6835a033955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:09.996793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d3ce-e0f3-4e37-bc8d-e6835a033955 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:09.997073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d3ce-e0f3-4e37-bc8d-e6835a033955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:09.997375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633d3ce-e0f3-4e37-bc8d-e6835a033955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:09.999302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2633d3ce-e0f3-4e37-bc8d-e6835a033955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:10.057806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:10.124599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633d3ce-e0f3-4e37-bc8d-e6835a033955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:10.126085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633d3ce-e0f3-4e37-bc8d-e6835a033955 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:10.148888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 653/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:12.505165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f1bc-7788-441c-ae85-ba82a01c9036 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:12.505763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f1bc-7788-441c-ae85-ba82a01c9036 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:12.505763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86f1bc-7788-441c-ae85-ba82a01c9036 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:12.507101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 659/1312] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:12.512661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b934-9fa1-459f-baa5-d3475108d856 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:12.513083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b934-9fa1-459f-baa5-d3475108d856 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:12.513365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052b934-9fa1-459f-baa5-d3475108d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:12.602468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1052b934-9fa1-459f-baa5-d3475108d856 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:12.603843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1052b934-9fa1-459f-baa5-d3475108d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:12.757473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 654/1313] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:12.796421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fc001-32e2-4071-b0ec-c0fbf36aa76d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:12.796864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fc001-32e2-4071-b0ec-c0fbf36aa76d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:12.797240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fc001-32e2-4071-b0ec-c0fbf36aa76d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:12.798943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 660/1314] 10.222.0.76 () {54 vars in 965 bytes} [Mon Jul 18 13:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:12.805191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbc9a2-9206-4384-a3ec-e39deab97112 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:12.805752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbc9a2-9206-4384-a3ec-e39deab97112 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:12.806040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbc9a2-9206-4384-a3ec-e39deab97112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:12.819466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:12.898084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c7fbc9a2-9206-4384-a3ec-e39deab97112 None None] MFA Rules not processed for user `2b28926500a14cd3aa74c59f60e076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:12.899318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7fbc9a2-9206-4384-a3ec-e39deab97112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:12.982047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 655/1315] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Jul 18 13:59:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:12.991946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fc001-32e2-4071-b0ec-c0fbf36aa76d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:12.993650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9f2fc001-32e2-4071-b0ec-c0fbf36aa76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:13.118866 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fc001-32e2-4071-b0ec-c0fbf36aa76d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:13.201934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:13.204600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479f0db-f8d3-435e-bdf4-edd5c308e4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:13.205409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f0db-f8d3-435e-bdf4-edd5c308e4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:13.205885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f0db-f8d3-435e-bdf4-edd5c308e4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:13.206325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f0db-f8d3-435e-bdf4-edd5c308e4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:13.208280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b479f0db-f8d3-435e-bdf4-edd5c308e4b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:13.318379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479f0db-f8d3-435e-bdf4-edd5c308e4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:13.319849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479f0db-f8d3-435e-bdf4-edd5c308e4b7 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:13.339303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 661/1316] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:15.908991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc370e64-3330-4fa8-8cbb-0b873b84e010 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:15.909709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc370e64-3330-4fa8-8cbb-0b873b84e010 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:15.909709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc370e64-3330-4fa8-8cbb-0b873b84e010 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:15.910936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 656/1317] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:15.916355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9a75-38ed-48d7-bb0a-4ff2efa6336a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:15.916776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9a75-38ed-48d7-bb0a-4ff2efa6336a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:15.916897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9a75-38ed-48d7-bb0a-4ff2efa6336a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:15.980406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e48d9a75-38ed-48d7-bb0a-4ff2efa6336a None None] MFA Rules not processed for user `721f2eb2b5b94eefaedcc5c977f20aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:15.981640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e48d9a75-38ed-48d7-bb0a-4ff2efa6336a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:16.036339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:16.086407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 662/1318] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:16.127744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc370e64-3330-4fa8-8cbb-0b873b84e010 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:16.129308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bc370e64-3330-4fa8-8cbb-0b873b84e010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:16.233743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc370e64-3330-4fa8-8cbb-0b873b84e010 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:16.236445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:16.307541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1131204-f294-450c-853f-77a2f126cdb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:16.308185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1131204-f294-450c-853f-77a2f126cdb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:16.308468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1131204-f294-450c-853f-77a2f126cdb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:16.308767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1131204-f294-450c-853f-77a2f126cdb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:16.311446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d1131204-f294-450c-853f-77a2f126cdb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:16.418806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1131204-f294-450c-853f-77a2f126cdb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:16.420981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1131204-f294-450c-853f-77a2f126cdb3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:16.441373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 657/1319] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:19.035935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4aa3-1794-4c36-827e-a942b036f3b0 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:19.036469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4aa3-1794-4c36-827e-a942b036f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:19.036469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df4aa3-1794-4c36-827e-a942b036f3b0 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:19.037887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 663/1320] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:19.043164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3db1a-fa9e-4d48-8ce4-83277d809d39 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:19.043602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3db1a-fa9e-4d48-8ce4-83277d809d39 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:19.043754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3db1a-fa9e-4d48-8ce4-83277d809d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:19.085333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:19.111876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c8f3db1a-fa9e-4d48-8ce4-83277d809d39 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:19.113100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c8f3db1a-fa9e-4d48-8ce4-83277d809d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:19.210927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 658/1321] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:19.250698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4aa3-1794-4c36-827e-a942b036f3b0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:19.252292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-00df4aa3-1794-4c36-827e-a942b036f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:19.356337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df4aa3-1794-4c36-827e-a942b036f3b0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:19.428537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026fd8b-6d4c-4d28-b0b2-7b33c213e7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:19.429178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026fd8b-6d4c-4d28-b0b2-7b33c213e7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:19.429497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026fd8b-6d4c-4d28-b0b2-7b33c213e7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:19.429774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026fd8b-6d4c-4d28-b0b2-7b33c213e7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:19.431421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a026fd8b-6d4c-4d28-b0b2-7b33c213e7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:19.439175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:19.539959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026fd8b-6d4c-4d28-b0b2-7b33c213e7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:19.541408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026fd8b-6d4c-4d28-b0b2-7b33c213e7d1 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:19.566888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 664/1322] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:22.228816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1322-f060-447b-946b-cbedee3b8b82 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:22.229395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1322-f060-447b-946b-cbedee3b8b82 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:22.229395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a1322-f060-447b-946b-cbedee3b8b82 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:22.230753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 659/1323] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:22.236651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64001-797b-4935-a00e-2b64da2cb460 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:22.237085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64001-797b-4935-a00e-2b64da2cb460 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:22.237214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64001-797b-4935-a00e-2b64da2cb460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:22.311057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-77c64001-797b-4935-a00e-2b64da2cb460 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:22.312294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-77c64001-797b-4935-a00e-2b64da2cb460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:22.369868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:22.410432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 665/1324] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:22.449645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a1322-f060-447b-946b-cbedee3b8b82 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:22.452015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ac7a1322-f060-447b-946b-cbedee3b8b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:22.566772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a1322-f060-447b-946b-cbedee3b8b82 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:22.580902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:22.647386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c4ecd-9a4e-4f15-a9af-b1ea884d58d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:22.647951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4ecd-9a4e-4f15-a9af-b1ea884d58d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:22.648228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4ecd-9a4e-4f15-a9af-b1ea884d58d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:22.648502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c4ecd-9a4e-4f15-a9af-b1ea884d58d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:22.650165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d88c4ecd-9a4e-4f15-a9af-b1ea884d58d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:22.759416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c4ecd-9a4e-4f15-a9af-b1ea884d58d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:22.760845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c4ecd-9a4e-4f15-a9af-b1ea884d58d7 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:22.779294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 660/1325] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:24.894397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fbfb-5765-4f9d-aabd-d69815b427b8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:24.894989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fbfb-5765-4f9d-aabd-d69815b427b8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:24.895108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fbfb-5765-4f9d-aabd-d69815b427b8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:24.896420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 666/1326] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:24.901787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00867d-39b1-48f5-aa3d-417784f229bb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:24.902195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00867d-39b1-48f5-aa3d-417784f229bb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:24.902342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00867d-39b1-48f5-aa3d-417784f229bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:24.950939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:24.970139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fd00867d-39b1-48f5-aa3d-417784f229bb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:24.971240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fd00867d-39b1-48f5-aa3d-417784f229bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:25.067969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 661/1327] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:25.104401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fbfb-5765-4f9d-aabd-d69815b427b8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:25.105991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7125fbfb-5765-4f9d-aabd-d69815b427b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:25.210844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fbfb-5765-4f9d-aabd-d69815b427b8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:25.282510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d73433-5950-4023-9e82-52114b87073c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:25.283153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d73433-5950-4023-9e82-52114b87073c service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:25.283429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d73433-5950-4023-9e82-52114b87073c service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:25.283698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d73433-5950-4023-9e82-52114b87073c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:25.285319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e3d73433-5950-4023-9e82-52114b87073c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:25.304131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:25.406739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d73433-5950-4023-9e82-52114b87073c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:25.408169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d73433-5950-4023-9e82-52114b87073c service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:25.427515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 667/1328] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:27.517180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3335019-c683-415d-8f6f-8c44a6169b55 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:27.517796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3335019-c683-415d-8f6f-8c44a6169b55 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:27.517796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3335019-c683-415d-8f6f-8c44a6169b55 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:27.519197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 662/1329] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:27.525261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbfbe0-534a-4ee7-a689-a13def5d7646 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:27.525835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbfbe0-534a-4ee7-a689-a13def5d7646 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:27.525935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbfbe0-534a-4ee7-a689-a13def5d7646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:27.597307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e8bbfbe0-534a-4ee7-a689-a13def5d7646 None None] MFA Rules not processed for user `721f2eb2b5b94eefaedcc5c977f20aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:27.598541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e8bbfbe0-534a-4ee7-a689-a13def5d7646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:27.662535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:27.695899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 668/1330] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:27.733902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3335019-c683-415d-8f6f-8c44a6169b55 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:27.735438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3335019-c683-415d-8f6f-8c44a6169b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:27.845923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3335019-c683-415d-8f6f-8c44a6169b55 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:27.865591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:27.920086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f3452-c22c-4f6c-aafb-0357bbe9ff9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:27.920738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3452-c22c-4f6c-aafb-0357bbe9ff9c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:27.921019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3452-c22c-4f6c-aafb-0357bbe9ff9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:27.921294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f3452-c22c-4f6c-aafb-0357bbe9ff9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:27.922981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de8f3452-c22c-4f6c-aafb-0357bbe9ff9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:28.036861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f3452-c22c-4f6c-aafb-0357bbe9ff9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:28.038334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f3452-c22c-4f6c-aafb-0357bbe9ff9c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:28.057206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 663/1331] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:30.320010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfad9bc-c269-4b87-9336-acd3b4b99690 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:30.320620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfad9bc-c269-4b87-9336-acd3b4b99690 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:30.320620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfad9bc-c269-4b87-9336-acd3b4b99690 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:30.321855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 669/1332] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:30.327709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c133b7-ebaa-4cc7-9dae-cfc27f239dba None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:30.328143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c133b7-ebaa-4cc7-9dae-cfc27f239dba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:30.328271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c133b7-ebaa-4cc7-9dae-cfc27f239dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:30.391759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:30.394562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b2c133b7-ebaa-4cc7-9dae-cfc27f239dba None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:30.396270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b2c133b7-ebaa-4cc7-9dae-cfc27f239dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:30.493000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 664/1333] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:30.530449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfad9bc-c269-4b87-9336-acd3b4b99690 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:30.531992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5bfad9bc-c269-4b87-9336-acd3b4b99690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:30.640444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfad9bc-c269-4b87-9336-acd3b4b99690 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:30.717335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199aab0-66b3-4c0e-bf39-5a5a053e0ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:30.718007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199aab0-66b3-4c0e-bf39-5a5a053e0ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:30.718289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199aab0-66b3-4c0e-bf39-5a5a053e0ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:30.718566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199aab0-66b3-4c0e-bf39-5a5a053e0ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:30.720206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b199aab0-66b3-4c0e-bf39-5a5a053e0ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:30.747545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:30.828832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199aab0-66b3-4c0e-bf39-5a5a053e0ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:30.830297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199aab0-66b3-4c0e-bf39-5a5a053e0ca3 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:30.849204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 670/1334] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:33.030042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83638-830f-4694-9b89-542ee066b459 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:33.030702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83638-830f-4694-9b89-542ee066b459 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:33.030702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab83638-830f-4694-9b89-542ee066b459 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:33.032788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 665/1335] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:33.038459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cc30-1063-49b0-a936-0ce3de22c214 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:33.038943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cc30-1063-49b0-a936-0ce3de22c214 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:33.039045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065cc30-1063-49b0-a936-0ce3de22c214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:33.117883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b065cc30-1063-49b0-a936-0ce3de22c214 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:33.119113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b065cc30-1063-49b0-a936-0ce3de22c214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:33.215066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:33.240683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 671/1336] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:33.287849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab83638-830f-4694-9b89-542ee066b459 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:33.289519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dab83638-830f-4694-9b89-542ee066b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:33.396772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab83638-830f-4694-9b89-542ee066b459 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:33.425756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:33.472034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548d241-1c56-418c-82e2-b48f0cd1e7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:33.472690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548d241-1c56-418c-82e2-b48f0cd1e7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:33.472973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548d241-1c56-418c-82e2-b48f0cd1e7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:33.473250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548d241-1c56-418c-82e2-b48f0cd1e7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:33.474947 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c548d241-1c56-418c-82e2-b48f0cd1e7d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:33.584952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548d241-1c56-418c-82e2-b48f0cd1e7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:33.586325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548d241-1c56-418c-82e2-b48f0cd1e7d2 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:33.604438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 666/1337] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:36.263747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c4d1a-fe2b-41ce-83e1-c1978b9231fd None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:36.264256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c4d1a-fe2b-41ce-83e1-c1978b9231fd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:36.264368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c4d1a-fe2b-41ce-83e1-c1978b9231fd None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:36.265855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 672/1338] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:36.271115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659109-862a-48e3-b8ef-d8b4aa51df4d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:36.271539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659109-862a-48e3-b8ef-d8b4aa51df4d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:36.271663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659109-862a-48e3-b8ef-d8b4aa51df4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:36.336093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-73659109-862a-48e3-b8ef-d8b4aa51df4d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:36.337307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-73659109-862a-48e3-b8ef-d8b4aa51df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:36.346280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:36.434966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 667/1339] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 13:59:36.471938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c4d1a-fe2b-41ce-83e1-c1978b9231fd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:36.473548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e01c4d1a-fe2b-41ce-83e1-c1978b9231fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:36.576333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c4d1a-fe2b-41ce-83e1-c1978b9231fd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:36.649041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaccc2a-32c2-47b7-8bde-149166a931a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:36.649656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaccc2a-32c2-47b7-8bde-149166a931a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:36.649941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaccc2a-32c2-47b7-8bde-149166a931a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:36.650214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaccc2a-32c2-47b7-8bde-149166a931a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:36.651986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eeaccc2a-32c2-47b7-8bde-149166a931a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:36.687442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:36.760184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaccc2a-32c2-47b7-8bde-149166a931a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:36.762309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaccc2a-32c2-47b7-8bde-149166a931a4 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:36.780645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 673/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:40.887811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f94b1-e85a-4b98-821c-2ca34d4ce171 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:40.888295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f94b1-e85a-4b98-821c-2ca34d4ce171 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:40.888295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f94b1-e85a-4b98-821c-2ca34d4ce171 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:40.889830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 668/1341] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 13:59:40.895067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ecd59-1561-4d32-846b-ab787c67eeb1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:40.895482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ecd59-1561-4d32-846b-ab787c67eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:40.895646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ecd59-1561-4d32-846b-ab787c67eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:40.961706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ba1ecd59-1561-4d32-846b-ab787c67eeb1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:40.962921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ba1ecd59-1561-4d32-846b-ab787c67eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:41.052459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:41.064377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 674/1342] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:41.104944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f94b1-e85a-4b98-821c-2ca34d4ce171 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:41.107723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-358f94b1-e85a-4b98-821c-2ca34d4ce171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:41.218117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f94b1-e85a-4b98-821c-2ca34d4ce171 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:41.257051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:41.294893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084f86-801e-415d-a689-c001632f11d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:41.295658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084f86-801e-415d-a689-c001632f11d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:41.295944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084f86-801e-415d-a689-c001632f11d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:41.296195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084f86-801e-415d-a689-c001632f11d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:41.297992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b084f86-801e-415d-a689-c001632f11d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:41.409012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084f86-801e-415d-a689-c001632f11d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:41.410601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084f86-801e-415d-a689-c001632f11d8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:41.428744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 669/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:44.116135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66b09-ed10-49fa-9cf3-99a5f947ad3b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:44.116729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66b09-ed10-49fa-9cf3-99a5f947ad3b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:44.116729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66b09-ed10-49fa-9cf3-99a5f947ad3b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:44.118122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 675/1344] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:44.124713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40087ac9-c66f-45f7-9ab4-73eb4e5f3ce9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:44.125383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40087ac9-c66f-45f7-9ab4-73eb4e5f3ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:44.125383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40087ac9-c66f-45f7-9ab4-73eb4e5f3ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:44.199629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-40087ac9-c66f-45f7-9ab4-73eb4e5f3ce9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:44.200856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40087ac9-c66f-45f7-9ab4-73eb4e5f3ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:44.220449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:44.306356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 670/1345] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:44.345277 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba66b09-ed10-49fa-9cf3-99a5f947ad3b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:44.346873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cba66b09-ed10-49fa-9cf3-99a5f947ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:44.454189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba66b09-ed10-49fa-9cf3-99a5f947ad3b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:44.530396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c394f40-9fea-4e30-b910-322f7561c423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:44.531050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c394f40-9fea-4e30-b910-322f7561c423 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:44.531332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c394f40-9fea-4e30-b910-322f7561c423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:44.531606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c394f40-9fea-4e30-b910-322f7561c423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:44.533256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3c394f40-9fea-4e30-b910-322f7561c423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:44.578379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:44.646140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c394f40-9fea-4e30-b910-322f7561c423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:44.647503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c394f40-9fea-4e30-b910-322f7561c423 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:44.665960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 676/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:48.944094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b56fe-8a09-4aca-8603-b7e7b04128ab None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:48.944579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b56fe-8a09-4aca-8603-b7e7b04128ab None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:48.944661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b56fe-8a09-4aca-8603-b7e7b04128ab None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:48.948493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 671/1347] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 13:59:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:48.953726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3a1c-3623-4ef1-a370-547842637e7f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:48.954330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3a1c-3623-4ef1-a370-547842637e7f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:48.954330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e3a1c-3623-4ef1-a370-547842637e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:49.026972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-157e3a1c-3623-4ef1-a370-547842637e7f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:49.028196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-157e3a1c-3623-4ef1-a370-547842637e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:49.130781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:49.133488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 677/1348] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 13:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:49.172994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b56fe-8a09-4aca-8603-b7e7b04128ab None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 13:59:49.174780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b9b56fe-8a09-4aca-8603-b7e7b04128ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:49.289550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b56fe-8a09-4aca-8603-b7e7b04128ab None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 13:59:49.349851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:49.380792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754f233-6f24-4b19-9cb3-904e61580fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 13:59:49.381525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f233-6f24-4b19-9cb3-904e61580fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:49.381821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f233-6f24-4b19-9cb3-904e61580fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:49.382291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754f233-6f24-4b19-9cb3-904e61580fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:49.384245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3754f233-6f24-4b19-9cb3-904e61580fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:49.522152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754f233-6f24-4b19-9cb3-904e61580fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 13:59:49.523590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754f233-6f24-4b19-9cb3-904e61580fd4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 13:59:49.542975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 672/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 13:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 13:59:54.466294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e723b3-72e4-4a1f-a032-06a89e729ceb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:54.466825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e723b3-72e4-4a1f-a032-06a89e729ceb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:54.466825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e723b3-72e4-4a1f-a032-06a89e729ceb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:54.468445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 678/1350] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:54.473548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59c2a-05f4-4660-9c13-8bfc59bbc2f0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:54.474518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59c2a-05f4-4660-9c13-8bfc59bbc2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:54.475248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c59c2a-05f4-4660-9c13-8bfc59bbc2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:54.616865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-50c59c2a-05f4-4660-9c13-8bfc59bbc2f0 None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:54.618250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-50c59c2a-05f4-4660-9c13-8bfc59bbc2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:54.640158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:54.747405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 673/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 13:59:58.924802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94dc57-59ca-4cc6-9dcd-a3bdf562dceb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:58.925915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94dc57-59ca-4cc6-9dcd-a3bdf562dceb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:58.926497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94dc57-59ca-4cc6-9dcd-a3bdf562dceb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:58.928983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 679/1352] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 13:59:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 13:59:58.934848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9365e-54df-4f89-b67f-f5375ce721db None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 13:59:58.935830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9365e-54df-4f89-b67f-f5375ce721db None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 13:59:58.936430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9365e-54df-4f89-b67f-f5375ce721db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 13:59:59.024698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a2e9365e-54df-4f89-b67f-f5375ce721db None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 13:59:59.026332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2e9365e-54df-4f89-b67f-f5375ce721db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 13:59:59.110478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 13:59:59.150247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 674/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:00.479767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109f89-88b6-4513-a214-07a96d88a0f4 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:00.480629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109f89-88b6-4513-a214-07a96d88a0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:00.480907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09109f89-88b6-4513-a214-07a96d88a0f4 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:00.482320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 680/1354] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:00.487558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c25f-783b-46f6-9433-db9189efe318 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:00.487981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c25f-783b-46f6-9433-db9189efe318 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:00.488123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c25f-783b-46f6-9433-db9189efe318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:00.562403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d7a3c25f-783b-46f6-9433-db9189efe318 None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:00.563607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7a3c25f-783b-46f6-9433-db9189efe318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:00.674011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 675/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:00:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:04.164742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314637c-bc40-48f6-a020-33b18a249d02 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:04.165531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314637c-bc40-48f6-a020-33b18a249d02 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:04.165531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314637c-bc40-48f6-a020-33b18a249d02 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:04.169432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 681/1356] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:04.175114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0ce0-9d20-4f1d-933f-c75590945398 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:04.175114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0ce0-9d20-4f1d-933f-c75590945398 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:04.176108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b0ce0-9d20-4f1d-933f-c75590945398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:04.225986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:04.269753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9b1b0ce0-9d20-4f1d-933f-c75590945398 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:04.270958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b1b0ce0-9d20-4f1d-933f-c75590945398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:04.381488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 676/1357] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:04.434730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51cd29-1e4b-46fa-acae-4d595e3f3294 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:04.435274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51cd29-1e4b-46fa-acae-4d595e3f3294 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:04.435771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51cd29-1e4b-46fa-acae-4d595e3f3294 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:04.437680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 682/1358] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 14:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:04.444787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d8fae-fad3-4261-bce4-3ff74506fb28 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:04.445393 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d8fae-fad3-4261-bce4-3ff74506fb28 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:04.445982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d8fae-fad3-4261-bce4-3ff74506fb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:04.535178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-350d8fae-fad3-4261-bce4-3ff74506fb28 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:04.536743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-350d8fae-fad3-4261-bce4-3ff74506fb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:04.591236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:04.663542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 677/1359] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:04.671323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51cd29-1e4b-46fa-acae-4d595e3f3294 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:04.672897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dd51cd29-1e4b-46fa-acae-4d595e3f3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:04.832637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51cd29-1e4b-46fa-acae-4d595e3f3294 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:04.910860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:04.957565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d390069-c4d7-4a01-a040-539133651d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:04.958125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390069-c4d7-4a01-a040-539133651d15 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:04.958401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390069-c4d7-4a01-a040-539133651d15 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:04.958672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390069-c4d7-4a01-a040-539133651d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:04.965365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4d390069-c4d7-4a01-a040-539133651d15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:05.069972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d390069-c4d7-4a01-a040-539133651d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:05.072340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d390069-c4d7-4a01-a040-539133651d15 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:05.094521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 683/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:07.364447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3a15-9e34-4512-af88-f8a248c8bea0 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:07.364876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3a15-9e34-4512-af88-f8a248c8bea0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:07.365184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd3a15-9e34-4512-af88-f8a248c8bea0 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:07.367831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 678/1361] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:07.373921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56570a-d3f5-44da-9167-1bdc5d2207de None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:07.374409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56570a-d3f5-44da-9167-1bdc5d2207de None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:07.374519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56570a-d3f5-44da-9167-1bdc5d2207de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:07.443125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ab56570a-d3f5-44da-9167-1bdc5d2207de None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:07.444328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ab56570a-d3f5-44da-9167-1bdc5d2207de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:07.483713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:07.546481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 684/1362] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:07.595021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3a15-9e34-4512-af88-f8a248c8bea0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:07.596839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-53dd3a15-9e34-4512-af88-f8a248c8bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:07.783888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd3a15-9e34-4512-af88-f8a248c8bea0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:07.794221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:07.935791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8a3e7-cb7a-410e-a768-2a0fe3ab1113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:07.936547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8a3e7-cb7a-410e-a768-2a0fe3ab1113 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:07.936896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8a3e7-cb7a-410e-a768-2a0fe3ab1113 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:07.937241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8a3e7-cb7a-410e-a768-2a0fe3ab1113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:07.939070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-23a8a3e7-cb7a-410e-a768-2a0fe3ab1113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:08.036418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8a3e7-cb7a-410e-a768-2a0fe3ab1113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:08.038053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8a3e7-cb7a-410e-a768-2a0fe3ab1113 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:08.058847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 679/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:10.478119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae6f3-30a5-4585-98e3-c91c91e61355 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:10.478665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae6f3-30a5-4585-98e3-c91c91e61355 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:10.478665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adae6f3-30a5-4585-98e3-c91c91e61355 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:10.479945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 685/1364] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:10.485819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71cf14-e16d-41a1-b035-0ea4197a6996 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:10.486612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71cf14-e16d-41a1-b035-0ea4197a6996 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:10.486898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71cf14-e16d-41a1-b035-0ea4197a6996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:10.505711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:10.578804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8f71cf14-e16d-41a1-b035-0ea4197a6996 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:10.580043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8f71cf14-e16d-41a1-b035-0ea4197a6996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:10.685640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 680/1365] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:10.732853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2b5f4-5475-4e63-aa6a-e5fff9ba6641 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:10.733410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2b5f4-5475-4e63-aa6a-e5fff9ba6641 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:10.733763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2b5f4-5475-4e63-aa6a-e5fff9ba6641 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:10.735366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 686/1366] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 14:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:10.740677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b318c-a6ca-445c-91a1-141883408333 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:10.740970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b318c-a6ca-445c-91a1-141883408333 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:10.741252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b318c-a6ca-445c-91a1-141883408333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:10.828090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7a7b318c-a6ca-445c-91a1-141883408333 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:10.830225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7a7b318c-a6ca-445c-91a1-141883408333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:10.869592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:10.967126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 681/1367] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:10.975300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2b5f4-5475-4e63-aa6a-e5fff9ba6641 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:10.976949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e1a2b5f4-5475-4e63-aa6a-e5fff9ba6641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:11.149796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2b5f4-5475-4e63-aa6a-e5fff9ba6641 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:11.182602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:11.290408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289368f-bdba-4551-b53c-56ec34bd07bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:11.291090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289368f-bdba-4551-b53c-56ec34bd07bb service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:11.291369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289368f-bdba-4551-b53c-56ec34bd07bb service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:11.291639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289368f-bdba-4551-b53c-56ec34bd07bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:11.293299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5289368f-bdba-4551-b53c-56ec34bd07bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:11.389164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289368f-bdba-4551-b53c-56ec34bd07bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:11.390853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289368f-bdba-4551-b53c-56ec34bd07bb service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:11.410020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 687/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:12.399382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054678b4-1b9e-428f-b906-df3a8fb53069 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:12.399896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054678b4-1b9e-428f-b906-df3a8fb53069 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:12.399896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054678b4-1b9e-428f-b906-df3a8fb53069 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:12.401292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 682/1369] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:12.406656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7326e-debe-41c5-83f6-81e0cd12277c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:12.407064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7326e-debe-41c5-83f6-81e0cd12277c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:12.407237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7326e-debe-41c5-83f6-81e0cd12277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:12.440169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:12.481099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6fb7326e-debe-41c5-83f6-81e0cd12277c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:12.483076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6fb7326e-debe-41c5-83f6-81e0cd12277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:12.592612 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 688/1370] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:12.947918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037600-9066-40c5-9ea4-0e152804127a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:12.947918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037600-9066-40c5-9ea4-0e152804127a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:12.947918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037600-9066-40c5-9ea4-0e152804127a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:12.950653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 683/1371] 10.222.0.76 () {54 vars in 964 bytes} [Mon Jul 18 14:00:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:12.955630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c31e2-d2ad-4978-8742-27d5c4b4d6a8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:12.956000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c31e2-d2ad-4978-8742-27d5c4b4d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:12.956357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c31e2-d2ad-4978-8742-27d5c4b4d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:13.041598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-904c31e2-d2ad-4978-8742-27d5c4b4d6a8 None None] MFA Rules not processed for user `ae320f14f9e4422aa99f91fe730cdd2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:13.042996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-904c31e2-d2ad-4978-8742-27d5c4b4d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:13.104690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:13.135120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 689/1372] 10.222.0.76 () {58 vars in 1061 bytes} [Mon Jul 18 14:00:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:13.142837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037600-9066-40c5-9ea4-0e152804127a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:13.144529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1037600-9066-40c5-9ea4-0e152804127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:13.256058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037600-9066-40c5-9ea4-0e152804127a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:13.300646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:13.339850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed4f9b-ce3b-412c-9411-3941b41872a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:13.340602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed4f9b-ce3b-412c-9411-3941b41872a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:13.340986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed4f9b-ce3b-412c-9411-3941b41872a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:13.341377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed4f9b-ce3b-412c-9411-3941b41872a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:13.343155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75ed4f9b-ce3b-412c-9411-3941b41872a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:13.465193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed4f9b-ce3b-412c-9411-3941b41872a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:13.466752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed4f9b-ce3b-412c-9411-3941b41872a0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:13.490085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 684/1373] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:00:13.529290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8990-89ac-454f-a16a-e2356ac7c3ae None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:13.529826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8990-89ac-454f-a16a-e2356ac7c3ae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:13.530011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b8990-89ac-454f-a16a-e2356ac7c3ae None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:13.533840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 690/1374] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:13.536344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce994c-cc66-493f-a4e5-4686c30a8d90 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:13.536627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce994c-cc66-493f-a4e5-4686c30a8d90 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:13.536985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce994c-cc66-493f-a4e5-4686c30a8d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:13.604913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4cce994c-cc66-493f-a4e5-4686c30a8d90 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:13.606153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4cce994c-cc66-493f-a4e5-4686c30a8d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:13.627977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:13.719865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 685/1375] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:13.768913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b8990-89ac-454f-a16a-e2356ac7c3ae None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:13.773506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd2b8990-89ac-454f-a16a-e2356ac7c3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:13.946683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b8990-89ac-454f-a16a-e2356ac7c3ae None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:13.998108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:14.064508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b11c6-f720-41e4-83a8-34f2730491ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:14.065198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b11c6-f720-41e4-83a8-34f2730491ac service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:14.065523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b11c6-f720-41e4-83a8-34f2730491ac service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:14.065834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b11c6-f720-41e4-83a8-34f2730491ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:14.067505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a18b11c6-f720-41e4-83a8-34f2730491ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:14.165276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b11c6-f720-41e4-83a8-34f2730491ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:14.166903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b11c6-f720-41e4-83a8-34f2730491ac service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:14.186207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 691/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:16.255327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cabde6-30cf-4cf1-996a-ecd5370936f5 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:16.255843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cabde6-30cf-4cf1-996a-ecd5370936f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:16.255843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cabde6-30cf-4cf1-996a-ecd5370936f5 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:16.257823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 686/1377] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:16.263083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74d69-4bb6-4340-a720-af7e705896c5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:16.263493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74d69-4bb6-4340-a720-af7e705896c5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:16.263636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a74d69-4bb6-4340-a720-af7e705896c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:16.332367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-61a74d69-4bb6-4340-a720-af7e705896c5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:16.333593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-61a74d69-4bb6-4340-a720-af7e705896c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:16.340969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:16.439721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 692/1378] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:16.490035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cabde6-30cf-4cf1-996a-ecd5370936f5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:16.490035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-59cabde6-30cf-4cf1-996a-ecd5370936f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:16.658455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cabde6-30cf-4cf1-996a-ecd5370936f5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:16.661991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:16.776222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693fec-3b7b-4d6d-8e9c-431c886db24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:16.776895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693fec-3b7b-4d6d-8e9c-431c886db24c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:16.777181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693fec-3b7b-4d6d-8e9c-431c886db24c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:16.777489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693fec-3b7b-4d6d-8e9c-431c886db24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:16.779120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da693fec-3b7b-4d6d-8e9c-431c886db24c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:16.889729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693fec-3b7b-4d6d-8e9c-431c886db24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:16.891484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693fec-3b7b-4d6d-8e9c-431c886db24c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:16.910487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 687/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:19.044416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc965d-be30-46d1-916f-66e1e696a5c7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:19.045049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc965d-be30-46d1-916f-66e1e696a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:19.045308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc965d-be30-46d1-916f-66e1e696a5c7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:19.047182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 693/1380] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:19.053433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c00c0-15f3-4e5f-94a4-dea830858b34 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:19.054016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c00c0-15f3-4e5f-94a4-dea830858b34 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:19.054252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c00c0-15f3-4e5f-94a4-dea830858b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:19.066223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:19.136603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f79c00c0-15f3-4e5f-94a4-dea830858b34 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:19.138165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f79c00c0-15f3-4e5f-94a4-dea830858b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:19.249835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 688/1381] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:19.295464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc965d-be30-46d1-916f-66e1e696a5c7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:19.296945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-39dc965d-be30-46d1-916f-66e1e696a5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:19.447298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:19.458935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc965d-be30-46d1-916f-66e1e696a5c7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:19.582182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ee96c-59f6-4138-bfcb-8cbd3db6b487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:19.582754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ee96c-59f6-4138-bfcb-8cbd3db6b487 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:19.583035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ee96c-59f6-4138-bfcb-8cbd3db6b487 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:19.583311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ee96c-59f6-4138-bfcb-8cbd3db6b487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:19.585523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b7ee96c-59f6-4138-bfcb-8cbd3db6b487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:19.690019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ee96c-59f6-4138-bfcb-8cbd3db6b487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:19.691629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ee96c-59f6-4138-bfcb-8cbd3db6b487 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:19.703546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:19.713430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 694/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:21.818755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5282c6-d9ed-49e0-b85e-e995147d612c None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:21.819359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5282c6-d9ed-49e0-b85e-e995147d612c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:21.819776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5282c6-d9ed-49e0-b85e-e995147d612c None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:21.822200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 689/1383] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:21.830974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b028d1f-e690-484e-a971-13a0f8dbc12c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:21.831496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b028d1f-e690-484e-a971-13a0f8dbc12c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:21.831593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b028d1f-e690-484e-a971-13a0f8dbc12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:21.902048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3b028d1f-e690-484e-a971-13a0f8dbc12c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:21.903281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3b028d1f-e690-484e-a971-13a0f8dbc12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:22.041214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 695/1384] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:22.083890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5282c6-d9ed-49e0-b85e-e995147d612c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:22.086185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ff5282c6-d9ed-49e0-b85e-e995147d612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:22.192419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:22.297028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5282c6-d9ed-49e0-b85e-e995147d612c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:22.416809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e2c03-1eef-4b44-8984-c920c086d409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:22.417410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2c03-1eef-4b44-8984-c920c086d409 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:22.417698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2c03-1eef-4b44-8984-c920c086d409 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:22.417974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e2c03-1eef-4b44-8984-c920c086d409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:22.419646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea0e2c03-1eef-4b44-8984-c920c086d409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:22.470989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:22.517192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2c03-1eef-4b44-8984-c920c086d409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:22.518843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e2c03-1eef-4b44-8984-c920c086d409 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:22.538021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 690/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:24.966648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6873ea-43f1-43fb-9659-7dedad5f7d02 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:24.967194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6873ea-43f1-43fb-9659-7dedad5f7d02 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:24.967194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6873ea-43f1-43fb-9659-7dedad5f7d02 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:24.969569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 696/1386] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:24.975058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63fb2-50a5-4ccb-b221-3e3b5a4e2b49 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:24.975686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63fb2-50a5-4ccb-b221-3e3b5a4e2b49 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:24.976089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f63fb2-50a5-4ccb-b221-3e3b5a4e2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:25.046893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-14f63fb2-50a5-4ccb-b221-3e3b5a4e2b49 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:25.048772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-14f63fb2-50a5-4ccb-b221-3e3b5a4e2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:25.153375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 691/1387] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:25.199844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6873ea-43f1-43fb-9659-7dedad5f7d02 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:25.201482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5b6873ea-43f1-43fb-9659-7dedad5f7d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:25.292519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:25.380613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6873ea-43f1-43fb-9659-7dedad5f7d02 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:25.519935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18294ce-c75c-440c-b8d6-a19b0dabddc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:25.520584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18294ce-c75c-440c-b8d6-a19b0dabddc7 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:25.520865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18294ce-c75c-440c-b8d6-a19b0dabddc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:25.521173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18294ce-c75c-440c-b8d6-a19b0dabddc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:25.523018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b18294ce-c75c-440c-b8d6-a19b0dabddc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:25.563189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:25.616904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18294ce-c75c-440c-b8d6-a19b0dabddc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:25.618580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18294ce-c75c-440c-b8d6-a19b0dabddc7 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:25.637257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 697/1388] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:27.746861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2ee1-a981-4c83-bda6-ad51ef2a40d2 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:27.747465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2ee1-a981-4c83-bda6-ad51ef2a40d2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:27.747465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2ee1-a981-4c83-bda6-ad51ef2a40d2 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:27.748778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 692/1389] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:27.753902 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187212e1-19b0-4d37-985c-58c00a2b9d37 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:27.754343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187212e1-19b0-4d37-985c-58c00a2b9d37 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:27.754576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187212e1-19b0-4d37-985c-58c00a2b9d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:27.821895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-187212e1-19b0-4d37-985c-58c00a2b9d37 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:27.823107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-187212e1-19b0-4d37-985c-58c00a2b9d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:27.927643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 698/1390] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:00:27.975952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2ee1-a981-4c83-bda6-ad51ef2a40d2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:27.977501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5f4c2ee1-a981-4c83-bda6-ad51ef2a40d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:28.012135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:28.141798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2ee1-a981-4c83-bda6-ad51ef2a40d2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:28.248350 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:28.260496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619df7e-e80b-4950-825f-3371b16cc3b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:28.261152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619df7e-e80b-4950-825f-3371b16cc3b7 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:28.261467 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619df7e-e80b-4950-825f-3371b16cc3b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:28.261747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619df7e-e80b-4950-825f-3371b16cc3b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:28.263457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5619df7e-e80b-4950-825f-3371b16cc3b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:28.355597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619df7e-e80b-4950-825f-3371b16cc3b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:28.357212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619df7e-e80b-4950-825f-3371b16cc3b7 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:28.375730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 693/1391] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:28.635672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a0e11-29a1-429c-8d5d-b72a63a510bb None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:28.636257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a0e11-29a1-429c-8d5d-b72a63a510bb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:28.636562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a0e11-29a1-429c-8d5d-b72a63a510bb None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:28.638071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 699/1392] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:28.643525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b86ea-e3ee-4189-b1b1-55394085dfae None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:28.643818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b86ea-e3ee-4189-b1b1-55394085dfae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:28.644098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b86ea-e3ee-4189-b1b1-55394085dfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:28.711157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-419b86ea-e3ee-4189-b1b1-55394085dfae None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:28.712378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-419b86ea-e3ee-4189-b1b1-55394085dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:28.773232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:28.812545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 694/1393] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:28.869674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5bf9-aad5-4629-8b57-c65b7493c7f7 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:28.870525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5bf9-aad5-4629-8b57-c65b7493c7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:28.870525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5bf9-aad5-4629-8b57-c65b7493c7f7 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:28.872568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 700/1394] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 14:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:28.877737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9340f-7cbf-4c90-872d-c96c7cf0282a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:28.878024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9340f-7cbf-4c90-872d-c96c7cf0282a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:28.878302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9340f-7cbf-4c90-872d-c96c7cf0282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:28.954151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-80e9340f-7cbf-4c90-872d-c96c7cf0282a None None] MFA Rules not processed for user `fbcb9f234fd740fbb644d79ef7215f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:28.955258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-80e9340f-7cbf-4c90-872d-c96c7cf0282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:29.032470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 695/1395] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:29.040820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5bf9-aad5-4629-8b57-c65b7493c7f7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:29.042467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-666b5bf9-aad5-4629-8b57-c65b7493c7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:29.057543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:29.159076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5bf9-aad5-4629-8b57-c65b7493c7f7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:29.234038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae66084-6532-4dbc-83da-2627c66dfb82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:29.234638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae66084-6532-4dbc-83da-2627c66dfb82 service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:29.234924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae66084-6532-4dbc-83da-2627c66dfb82 service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:29.235204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae66084-6532-4dbc-83da-2627c66dfb82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:29.236926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ae66084-6532-4dbc-83da-2627c66dfb82 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:29.304914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:29.356127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae66084-6532-4dbc-83da-2627c66dfb82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:29.357601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae66084-6532-4dbc-83da-2627c66dfb82 service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:29.375814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 701/1396] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:30.093876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6e26-5d2f-4972-a4ed-54637b136867 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:30.094307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6e26-5d2f-4972-a4ed-54637b136867 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:30.094637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6e26-5d2f-4972-a4ed-54637b136867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:30.162204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1feb6e26-5d2f-4972-a4ed-54637b136867 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:30.163962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1feb6e26-5d2f-4972-a4ed-54637b136867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:30.172381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:30.250894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 696/1397] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:30.303533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb42500-615f-4c70-a85e-3318b45b7a5f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:30.304344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb42500-615f-4c70-a85e-3318b45b7a5f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:30.304696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb42500-615f-4c70-a85e-3318b45b7a5f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:30.306204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 702/1398] 10.222.0.76 () {54 vars in 943 bytes} [Mon Jul 18 14:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:30.313207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46232606-e2d8-4b67-aae4-8581069927fa None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:30.313647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46232606-e2d8-4b67-aae4-8581069927fa None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:30.313927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46232606-e2d8-4b67-aae4-8581069927fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:30.391560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-46232606-e2d8-4b67-aae4-8581069927fa None None] MFA Rules not processed for user `38d55235b0374bfa8ea73ac3f4e2836b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:30.392685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-46232606-e2d8-4b67-aae4-8581069927fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:30.459718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f879-29e2-439b-907f-d43e8b63266e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:30.460033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f879-29e2-439b-907f-d43e8b63266e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:30.460295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f879-29e2-439b-907f-d43e8b63266e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:30.461853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 703/1399] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:00:30.466718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:30.466999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:30.467277 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:30.480341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:30.504558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 697/1400] 10.222.0.76 () {58 vars in 1040 bytes} [Mon Jul 18 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:30.514198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46232606-e2d8-4b67-aae4-8581069927fa None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:30.524487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46232606-e2d8-4b67-aae4-8581069927fa None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:30.546323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:30.547560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:30.633489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7ad81-5720-47f5-a307-0df7692661db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:30.634042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7ad81-5720-47f5-a307-0df7692661db service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:30.634329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7ad81-5720-47f5-a307-0df7692661db service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:30.634609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7ad81-5720-47f5-a307-0df7692661db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:30.636318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f6e7ad81-5720-47f5-a307-0df7692661db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:30.647633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 704/1401] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:00:30.693608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:30.694818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:30.721873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:30.724700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7ad81-5720-47f5-a307-0df7692661db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:30.726428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7ad81-5720-47f5-a307-0df7692661db service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:30.734927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 698/1402] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:00:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 14:00:30.821809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14c0e5-51b7-4218-a391-976168a7bdfa None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:30.962594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38079f6c-ceb4-4aec-81c4-eab7027368ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:30.963168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079f6c-ceb4-4aec-81c4-eab7027368ca service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:30.963448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079f6c-ceb4-4aec-81c4-eab7027368ca service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:30.963729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079f6c-ceb4-4aec-81c4-eab7027368ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:30.965437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-38079f6c-ceb4-4aec-81c4-eab7027368ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:30.986405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:31.066092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38079f6c-ceb4-4aec-81c4-eab7027368ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:31.068243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38079f6c-ceb4-4aec-81c4-eab7027368ca service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:31.089694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 705/1403] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:00:33.191557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f1f46-a768-4404-a24f-f443ff2794f9 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:33.192145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f1f46-a768-4404-a24f-f443ff2794f9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:33.192145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f1f46-a768-4404-a24f-f443ff2794f9 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:33.194216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 699/1404] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:33.199556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becfb5-7a5f-4cd2-b782-d84fdff171a4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:33.200438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becfb5-7a5f-4cd2-b782-d84fdff171a4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:33.200715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becfb5-7a5f-4cd2-b782-d84fdff171a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:33.271368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d0becfb5-7a5f-4cd2-b782-d84fdff171a4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:33.272895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d0becfb5-7a5f-4cd2-b782-d84fdff171a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:33.384992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:33.405688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 706/1405] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:33.441237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f1f46-a768-4404-a24f-f443ff2794f9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:33.442955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0a5f1f46-a768-4404-a24f-f443ff2794f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:33.453801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:33.627451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f1f46-a768-4404-a24f-f443ff2794f9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:33.725475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:33.770290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad71111-98cf-462b-b033-97202381546e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:33.771019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad71111-98cf-462b-b033-97202381546e service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:33.771311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad71111-98cf-462b-b033-97202381546e service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:33.771591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad71111-98cf-462b-b033-97202381546e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:33.773362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8ad71111-98cf-462b-b033-97202381546e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:33.886403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad71111-98cf-462b-b033-97202381546e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:33.888015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad71111-98cf-462b-b033-97202381546e service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:33.912459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 700/1406] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:36.115690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dcd8c-3a9a-4e79-ad18-8fed6499dac3 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:36.116242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dcd8c-3a9a-4e79-ad18-8fed6499dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:36.116242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795dcd8c-3a9a-4e79-ad18-8fed6499dac3 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:36.117789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 707/1407] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:36.122964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ae62e-38f3-4a94-ae9d-2b6a114bce8e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:36.123734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ae62e-38f3-4a94-ae9d-2b6a114bce8e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:36.124018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ae62e-38f3-4a94-ae9d-2b6a114bce8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:36.197303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8c9ae62e-38f3-4a94-ae9d-2b6a114bce8e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:36.198818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c9ae62e-38f3-4a94-ae9d-2b6a114bce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:36.268469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:36.337993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 701/1408] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:00:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:36.379455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dcd8c-3a9a-4e79-ad18-8fed6499dac3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:36.381644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-795dcd8c-3a9a-4e79-ad18-8fed6499dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:36.557887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795dcd8c-3a9a-4e79-ad18-8fed6499dac3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:36.633040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:36.685842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16486456-f454-42b7-8074-1f2804b6c95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:36.686811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486456-f454-42b7-8074-1f2804b6c95c service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:36.687156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486456-f454-42b7-8074-1f2804b6c95c service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:36.687481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486456-f454-42b7-8074-1f2804b6c95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:36.689155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-16486456-f454-42b7-8074-1f2804b6c95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:36.788052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16486456-f454-42b7-8074-1f2804b6c95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:36.790026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16486456-f454-42b7-8074-1f2804b6c95c service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:36.830659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 708/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:46.329870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=23 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:46.816873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=64 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:53.292123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc7b5-e9d7-4258-ba2a-99050c685dfb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:53.292727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc7b5-e9d7-4258-ba2a-99050c685dfb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:53.292727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc7b5-e9d7-4258-ba2a-99050c685dfb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:53.294113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 702/1410] 10.222.0.76 () {54 vars in 918 bytes} [Mon Jul 18 14:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:53.299285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef5e23-7a50-459c-a384-e669ad65b224 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:53.299716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef5e23-7a50-459c-a384-e669ad65b224 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:53.299825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef5e23-7a50-459c-a384-e669ad65b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:53.373297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7aef5e23-7a50-459c-a384-e669ad65b224 None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:53.374447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7aef5e23-7a50-459c-a384-e669ad65b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:53.480335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 709/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Jul 18 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:53.494959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7b2cf-4b16-4f15-bfea-a3b0f627983f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:53.495245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7b2cf-4b16-4f15-bfea-a3b0f627983f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:53.495517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7b2cf-4b16-4f15-bfea-a3b0f627983f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:53.496877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 703/1412] 10.222.0.76 () {54 vars in 918 bytes} [Mon Jul 18 14:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:53.501407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaa0af-ab11-42ea-8f55-2117915f4215 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:53.501705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaa0af-ab11-42ea-8f55-2117915f4215 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:53.501988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eaa0af-ab11-42ea-8f55-2117915f4215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:53.573838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:53.576366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-49eaa0af-ab11-42ea-8f55-2117915f4215 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:53.578200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-49eaa0af-ab11-42ea-8f55-2117915f4215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:53.694966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 710/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Jul 18 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:56.192448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c31d0-9e35-4e0f-b17b-c6a54d51a529 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:56.193060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c31d0-9e35-4e0f-b17b-c6a54d51a529 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:56.193060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c31d0-9e35-4e0f-b17b-c6a54d51a529 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:56.194988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:56.200228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77bca-59b1-4ea9-a14f-e2d8e5f7543b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:56.200620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77bca-59b1-4ea9-a14f-e2d8e5f7543b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:56.200790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77bca-59b1-4ea9-a14f-e2d8e5f7543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:56.265897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0ad77bca-59b1-4ea9-a14f-e2d8e5f7543b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:56.267296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0ad77bca-59b1-4ea9-a14f-e2d8e5f7543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:56.322503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:56.367040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:56.409923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c31d0-9e35-4e0f-b17b-c6a54d51a529 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:56.411659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3a5c31d0-9e35-4e0f-b17b-c6a54d51a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:56.556298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c31d0-9e35-4e0f-b17b-c6a54d51a529 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:56.629019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:56.672602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b5356-dc17-4564-9cd7-1688215adbe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:56.673258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b5356-dc17-4564-9cd7-1688215adbe4 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:56.673568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b5356-dc17-4564-9cd7-1688215adbe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:56.673846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b5356-dc17-4564-9cd7-1688215adbe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:56.675491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fd1b5356-dc17-4564-9cd7-1688215adbe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:56.764956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b5356-dc17-4564-9cd7-1688215adbe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:56.766615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b5356-dc17-4564-9cd7-1688215adbe4 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:56.784554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 705/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:57.702381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0c46-ea4b-46b9-a8c1-b6efd212c8f5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:57.702991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0c46-ea4b-46b9-a8c1-b6efd212c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:57.702991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0c46-ea4b-46b9-a8c1-b6efd212c8f5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:57.704297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:57.710273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9213d-0900-412a-97ac-9a19bfdeb0dc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:57.710716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9213d-0900-412a-97ac-9a19bfdeb0dc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:57.710817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9213d-0900-412a-97ac-9a19bfdeb0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:57.785722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bec9213d-0900-412a-97ac-9a19bfdeb0dc None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:57.787602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bec9213d-0900-412a-97ac-9a19bfdeb0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:57.814829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:57.886389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:58.047487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d0c46-ea4b-46b9-a8c1-b6efd212c8f5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:58.049003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a43d0c46-ea4b-46b9-a8c1-b6efd212c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:58.195539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d0c46-ea4b-46b9-a8c1-b6efd212c8f5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:58.235191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:58.309123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9fdee-3456-43b3-80bf-55b8be6ec02f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:58.309728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9fdee-3456-43b3-80bf-55b8be6ec02f service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:58.310027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9fdee-3456-43b3-80bf-55b8be6ec02f service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:58.310305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9fdee-3456-43b3-80bf-55b8be6ec02f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:58.311993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-59f9fdee-3456-43b3-80bf-55b8be6ec02f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:58.404898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9fdee-3456-43b3-80bf-55b8be6ec02f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:00:58.406542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9fdee-3456-43b3-80bf-55b8be6ec02f service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:00:58.425030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 713/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:00:59.321853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5dbb-8c55-4c5f-90aa-67e1147b5799 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:59.322422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5dbb-8c55-4c5f-90aa-67e1147b5799 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:59.322422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e5dbb-8c55-4c5f-90aa-67e1147b5799 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:59.324103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:00:59.329199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb877c-253e-41a3-89cf-dbccfe299441 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:59.329673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb877c-253e-41a3-89cf-dbccfe299441 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:59.330016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb877c-253e-41a3-89cf-dbccfe299441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:59.384564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:59.406970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1dbb877c-253e-41a3-89cf-dbccfe299441 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:00:59.408209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1dbb877c-253e-41a3-89cf-dbccfe299441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:59.504189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:00:59.659356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e5dbb-8c55-4c5f-90aa-67e1147b5799 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:00:59.660825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b1e5dbb-8c55-4c5f-90aa-67e1147b5799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:00:59.808026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e5dbb-8c55-4c5f-90aa-67e1147b5799 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:00:59.820620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:00:59.922006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f3cfb-572e-4d2c-99cf-561ef1ae3399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:00:59.922599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f3cfb-572e-4d2c-99cf-561ef1ae3399 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:00:59.922879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f3cfb-572e-4d2c-99cf-561ef1ae3399 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:00:59.923155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f3cfb-572e-4d2c-99cf-561ef1ae3399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:00:59.924801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-180f3cfb-572e-4d2c-99cf-561ef1ae3399 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:00.015346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f3cfb-572e-4d2c-99cf-561ef1ae3399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:00.016964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f3cfb-572e-4d2c-99cf-561ef1ae3399 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:00.035675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 708/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:00:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:00.906170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242769d1-9815-46c3-b40d-5dffc40c4c60 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:00.906756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242769d1-9815-46c3-b40d-5dffc40c4c60 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:00.906756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242769d1-9815-46c3-b40d-5dffc40c4c60 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:00.908116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:00.914204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e3fa-be79-40c3-9379-244bfe272a19 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:00.914607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e3fa-be79-40c3-9379-244bfe272a19 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:00.914834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80e3fa-be79-40c3-9379-244bfe272a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:00.933856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:00.990722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ea80e3fa-be79-40c3-9379-244bfe272a19 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:00.991932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea80e3fa-be79-40c3-9379-244bfe272a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:01.090442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:01.239755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242769d1-9815-46c3-b40d-5dffc40c4c60 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:01.241931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-242769d1-9815-46c3-b40d-5dffc40c4c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:01.351367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:01.387559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242769d1-9815-46c3-b40d-5dffc40c4c60 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:01.499590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb104-3361-4578-8f78-a688e0e0930a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:01.500165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb104-3361-4578-8f78-a688e0e0930a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:01.500447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb104-3361-4578-8f78-a688e0e0930a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:01.500722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb104-3361-4578-8f78-a688e0e0930a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:01.502509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a0ddb104-3361-4578-8f78-a688e0e0930a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:01.579828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:01.594430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb104-3361-4578-8f78-a688e0e0930a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:01.596040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb104-3361-4578-8f78-a688e0e0930a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:01.614530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 716/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:02.473628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d66e7-91bf-44b5-b475-88a1f762929a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:02.474278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d66e7-91bf-44b5-b475-88a1f762929a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:02.474278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d66e7-91bf-44b5-b475-88a1f762929a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:02.475779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:02.480886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad741-e1f2-41d0-85ac-f02b0e7d428b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:02.481315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad741-e1f2-41d0-85ac-f02b0e7d428b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:02.481449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad741-e1f2-41d0-85ac-f02b0e7d428b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:02.557275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-53dad741-e1f2-41d0-85ac-f02b0e7d428b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:02.558578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-53dad741-e1f2-41d0-85ac-f02b0e7d428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:02.654271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:02.806367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d66e7-91bf-44b5-b475-88a1f762929a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:02.807912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-444d66e7-91bf-44b5-b475-88a1f762929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:02.892873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:02.955589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d66e7-91bf-44b5-b475-88a1f762929a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:03.068936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a65f60-9824-4013-814e-8e2d3283040c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:03.069542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65f60-9824-4013-814e-8e2d3283040c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:03.069827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65f60-9824-4013-814e-8e2d3283040c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:03.070111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a65f60-9824-4013-814e-8e2d3283040c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:03.071768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-77a65f60-9824-4013-814e-8e2d3283040c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:03.120978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:03.162187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65f60-9824-4013-814e-8e2d3283040c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:03.164472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a65f60-9824-4013-814e-8e2d3283040c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:03.183984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 711/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:03.993782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b936-8d05-421e-8f7b-8ac1d1405d2d None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:03.994443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b936-8d05-421e-8f7b-8ac1d1405d2d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:03.994443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31b936-8d05-421e-8f7b-8ac1d1405d2d None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:03.995708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:04.000820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca816-ea2d-453f-860e-f78dc87abc5f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:04.001289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca816-ea2d-453f-860e-f78dc87abc5f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:04.001466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca816-ea2d-453f-860e-f78dc87abc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:04.075445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-cd5ca816-ea2d-453f-860e-f78dc87abc5f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:04.076675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd5ca816-ea2d-453f-860e-f78dc87abc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:04.175306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:04.331304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b936-8d05-421e-8f7b-8ac1d1405d2d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:04.332833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bf31b936-8d05-421e-8f7b-8ac1d1405d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:04.382256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:04.479977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31b936-8d05-421e-8f7b-8ac1d1405d2d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:04.595036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dddc3-3240-4fd2-961e-31bf90feb115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:04.595601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dddc3-3240-4fd2-961e-31bf90feb115 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:04.595885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dddc3-3240-4fd2-961e-31bf90feb115 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:04.596160 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dddc3-3240-4fd2-961e-31bf90feb115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:04.597991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-780dddc3-3240-4fd2-961e-31bf90feb115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:04.604995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:04.689730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dddc3-3240-4fd2-961e-31bf90feb115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:04.691334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780dddc3-3240-4fd2-961e-31bf90feb115 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:04.711224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 719/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:05.533592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3924-70d7-4322-bdd2-628003d3f860 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:05.534140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3924-70d7-4322-bdd2-628003d3f860 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:05.534140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3924-70d7-4322-bdd2-628003d3f860 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:05.535524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:05.541174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0820-cd2b-4465-adb3-777807dcbf97 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:05.541649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0820-cd2b-4465-adb3-777807dcbf97 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:05.541793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0820-cd2b-4465-adb3-777807dcbf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:05.616306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-810f0820-cd2b-4465-adb3-777807dcbf97 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:05.617542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-810f0820-cd2b-4465-adb3-777807dcbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:05.685690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:05.715153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:05.865628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3924-70d7-4322-bdd2-628003d3f860 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:05.867364 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-493a3924-70d7-4322-bdd2-628003d3f860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:05.885004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:06.018837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3924-70d7-4322-bdd2-628003d3f860 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:06.108289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:06.134506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7908c-0859-40c5-812b-c0402d743f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:06.135088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7908c-0859-40c5-812b-c0402d743f01 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:06.135369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7908c-0859-40c5-812b-c0402d743f01 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:06.135644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7908c-0859-40c5-812b-c0402d743f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:06.137391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38b7908c-0859-40c5-812b-c0402d743f01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:06.234075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7908c-0859-40c5-812b-c0402d743f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:06.235716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7908c-0859-40c5-812b-c0402d743f01 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:06.258425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 714/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:07.077109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46dc8-6b11-4614-8a21-676ed8cf8b8e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:07.077694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46dc8-6b11-4614-8a21-676ed8cf8b8e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:07.077694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab46dc8-6b11-4614-8a21-676ed8cf8b8e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:07.079100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:07.084376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbabce0-4d9d-4385-9c08-ce3e434aa902 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:07.084990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbabce0-4d9d-4385-9c08-ce3e434aa902 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:07.084990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbabce0-4d9d-4385-9c08-ce3e434aa902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:07.159742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8cbabce0-4d9d-4385-9c08-ce3e434aa902 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:07.160856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8cbabce0-4d9d-4385-9c08-ce3e434aa902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:07.204964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:07.262070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:07.418487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46dc8-6b11-4614-8a21-676ed8cf8b8e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:07.419927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6ab46dc8-6b11-4614-8a21-676ed8cf8b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:07.565995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab46dc8-6b11-4614-8a21-676ed8cf8b8e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:07.622380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:07.682465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f82c96-0df8-4cc0-bd29-a7161c9aa96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:07.683041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82c96-0df8-4cc0-bd29-a7161c9aa96a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:07.683321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82c96-0df8-4cc0-bd29-a7161c9aa96a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:07.683596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f82c96-0df8-4cc0-bd29-a7161c9aa96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:07.685257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-06f82c96-0df8-4cc0-bd29-a7161c9aa96a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:07.775852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f82c96-0df8-4cc0-bd29-a7161c9aa96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:07.777474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f82c96-0df8-4cc0-bd29-a7161c9aa96a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:07.796145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 722/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:08.622676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2209bb-479b-4454-906e-db27dd733382 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:08.623205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2209bb-479b-4454-906e-db27dd733382 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:08.623321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2209bb-479b-4454-906e-db27dd733382 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:08.624641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:08.629745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a774e-2bf0-47e2-8b02-edb5c4f6fd5b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:08.630172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a774e-2bf0-47e2-8b02-edb5c4f6fd5b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:08.630337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a774e-2bf0-47e2-8b02-edb5c4f6fd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:08.705461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a19a774e-2bf0-47e2-8b02-edb5c4f6fd5b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:08.706682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a19a774e-2bf0-47e2-8b02-edb5c4f6fd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:08.708704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:08.806191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:08.958375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2209bb-479b-4454-906e-db27dd733382 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:08.960079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b2209bb-479b-4454-906e-db27dd733382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:09.105556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2209bb-479b-4454-906e-db27dd733382 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:09.133361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:09.219019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79212e2-5941-42dd-8e4a-a4fbe680d55c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:09.219667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79212e2-5941-42dd-8e4a-a4fbe680d55c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:09.219945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79212e2-5941-42dd-8e4a-a4fbe680d55c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:09.220216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79212e2-5941-42dd-8e4a-a4fbe680d55c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:09.221880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e79212e2-5941-42dd-8e4a-a4fbe680d55c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:09.310116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79212e2-5941-42dd-8e4a-a4fbe680d55c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:09.311720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79212e2-5941-42dd-8e4a-a4fbe680d55c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:09.329418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 717/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:11.259814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ac7e2-40d1-4a4f-9752-1e7e73658cdf None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:11.260383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ac7e2-40d1-4a4f-9752-1e7e73658cdf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:11.260383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ac7e2-40d1-4a4f-9752-1e7e73658cdf None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:11.261823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:11.267178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f6858-3d0f-4501-8c76-21bc1b782a35 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:11.267610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f6858-3d0f-4501-8c76-21bc1b782a35 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:11.267772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f6858-3d0f-4501-8c76-21bc1b782a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:11.307988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:11.334039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d09f6858-3d0f-4501-8c76-21bc1b782a35 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:11.335625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d09f6858-3d0f-4501-8c76-21bc1b782a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:11.432901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:11.472396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ac7e2-40d1-4a4f-9752-1e7e73658cdf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:11.474020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-108ac7e2-40d1-4a4f-9752-1e7e73658cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:11.579379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ac7e2-40d1-4a4f-9752-1e7e73658cdf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:11.611453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:11.653350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa6354-80d0-4227-838f-738fecbc29fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:11.654027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6354-80d0-4227-838f-738fecbc29fd service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:11.654302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6354-80d0-4227-838f-738fecbc29fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:11.654577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa6354-80d0-4227-838f-738fecbc29fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:11.656224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7caa6354-80d0-4227-838f-738fecbc29fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:11.769619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa6354-80d0-4227-838f-738fecbc29fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:11.771068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa6354-80d0-4227-838f-738fecbc29fd service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:11.906433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 725/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:14.144828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2600-e709-43ab-8e51-c05c60a0c8ac None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:14.145381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2600-e709-43ab-8e51-c05c60a0c8ac None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:14.145496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f2600-e709-43ab-8e51-c05c60a0c8ac None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:14.146843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:14.152725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d73d7-20d2-4268-8a6f-4730137cdac9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:14.153145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d73d7-20d2-4268-8a6f-4730137cdac9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:14.153260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d73d7-20d2-4268-8a6f-4730137cdac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:14.217421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fd2d73d7-20d2-4268-8a6f-4730137cdac9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:14.218614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fd2d73d7-20d2-4268-8a6f-4730137cdac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:14.231528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:14.316448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:14.355607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2600-e709-43ab-8e51-c05c60a0c8ac None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:14.357145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fb4f2600-e709-43ab-8e51-c05c60a0c8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:14.461754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f2600-e709-43ab-8e51-c05c60a0c8ac None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:14.473535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:14.545041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d38ac-0726-4539-90a7-9a9a1e324ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:14.545721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d38ac-0726-4539-90a7-9a9a1e324ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:14.546006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d38ac-0726-4539-90a7-9a9a1e324ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:14.546285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d38ac-0726-4539-90a7-9a9a1e324ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:14.547933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3d3d38ac-0726-4539-90a7-9a9a1e324ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:14.659324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d38ac-0726-4539-90a7-9a9a1e324ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:14.660677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d38ac-0726-4539-90a7-9a9a1e324ff6 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:14.680455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 720/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:17.041184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a9c0-6ee7-44c8-aad4-377299b8cff5 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:17.041787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a9c0-6ee7-44c8-aad4-377299b8cff5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:17.041787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a9c0-6ee7-44c8-aad4-377299b8cff5 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:17.043163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:17.048713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deea3e-9db5-498c-8bc9-f6ec1615b97e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:17.049115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deea3e-9db5-498c-8bc9-f6ec1615b97e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:17.049281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deea3e-9db5-498c-8bc9-f6ec1615b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:17.097308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:17.115608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-52deea3e-9db5-498c-8bc9-f6ec1615b97e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:17.117428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-52deea3e-9db5-498c-8bc9-f6ec1615b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:17.213851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:17.252859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a9c0-6ee7-44c8-aad4-377299b8cff5 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:17.254435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0bf5a9c0-6ee7-44c8-aad4-377299b8cff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:17.360293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a9c0-6ee7-44c8-aad4-377299b8cff5 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:17.400158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:17.434464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732dd1d7-c960-46f9-9e5d-3b28b7ac82d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:17.435102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd1d7-c960-46f9-9e5d-3b28b7ac82d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:17.435416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd1d7-c960-46f9-9e5d-3b28b7ac82d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:17.435683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732dd1d7-c960-46f9-9e5d-3b28b7ac82d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:17.437356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-732dd1d7-c960-46f9-9e5d-3b28b7ac82d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:17.545243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dd1d7-c960-46f9-9e5d-3b28b7ac82d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:17.546782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732dd1d7-c960-46f9-9e5d-3b28b7ac82d2 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:17.565630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 728/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:19.720501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959dbb4-7244-4696-b563-7f12ceae2507 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:19.721066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959dbb4-7244-4696-b563-7f12ceae2507 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:19.721066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959dbb4-7244-4696-b563-7f12ceae2507 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:19.722522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:19.727910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c91835-0149-4183-b1d6-fb41a6f8cd1c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:19.728298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c91835-0149-4183-b1d6-fb41a6f8cd1c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:19.728465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c91835-0149-4183-b1d6-fb41a6f8cd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:19.794971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-47c91835-0149-4183-b1d6-fb41a6f8cd1c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:19.796198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-47c91835-0149-4183-b1d6-fb41a6f8cd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:19.822221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:19.894565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:01:19.934285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959dbb4-7244-4696-b563-7f12ceae2507 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:19.935860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d959dbb4-7244-4696-b563-7f12ceae2507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:20.040383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959dbb4-7244-4696-b563-7f12ceae2507 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:20.061302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:20.119383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f26fd0-720a-4de4-9398-a598ce6c3907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:20.119383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f26fd0-720a-4de4-9398-a598ce6c3907 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:20.119383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f26fd0-720a-4de4-9398-a598ce6c3907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:20.119383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f26fd0-720a-4de4-9398-a598ce6c3907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:20.120669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b9f26fd0-720a-4de4-9398-a598ce6c3907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:20.235518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f26fd0-720a-4de4-9398-a598ce6c3907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:20.236953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f26fd0-720a-4de4-9398-a598ce6c3907 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:20.254888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 723/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:22.361597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59ed3-2688-4a64-847a-0e892bfab97e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:22.362104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59ed3-2688-4a64-847a-0e892bfab97e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:22.362104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59ed3-2688-4a64-847a-0e892bfab97e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:22.363461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:22.369523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658c05-b23e-42c3-afaa-619f8c9f5355 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:22.369966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658c05-b23e-42c3-afaa-619f8c9f5355 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:22.370099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658c05-b23e-42c3-afaa-619f8c9f5355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:22.444967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:22.448879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ec658c05-b23e-42c3-afaa-619f8c9f5355 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:22.450587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ec658c05-b23e-42c3-afaa-619f8c9f5355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:22.548189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:22.590650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d59ed3-2688-4a64-847a-0e892bfab97e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:22.592294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f3d59ed3-2688-4a64-847a-0e892bfab97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:22.704848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d59ed3-2688-4a64-847a-0e892bfab97e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:22.755293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:22.786043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f013386-2697-4084-b3d3-1120d4fd792b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:22.786714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013386-2697-4084-b3d3-1120d4fd792b service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:22.786993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013386-2697-4084-b3d3-1120d4fd792b service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:22.787268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f013386-2697-4084-b3d3-1120d4fd792b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:22.789493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1f013386-2697-4084-b3d3-1120d4fd792b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:22.900781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f013386-2697-4084-b3d3-1120d4fd792b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:22.902252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f013386-2697-4084-b3d3-1120d4fd792b service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:22.921479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 731/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:25.015830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1174-33f5-49dd-9c06-6874c42f7e68 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:25.016400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1174-33f5-49dd-9c06-6874c42f7e68 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:25.016400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1174-33f5-49dd-9c06-6874c42f7e68 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:25.017818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:25.023060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa042a-3ad7-402a-8756-49f6f25c3770 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:25.023534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa042a-3ad7-402a-8756-49f6f25c3770 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:25.023630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa042a-3ad7-402a-8756-49f6f25c3770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:25.095627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9dfa042a-3ad7-402a-8756-49f6f25c3770 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:25.096849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9dfa042a-3ad7-402a-8756-49f6f25c3770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:25.127545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:25.196796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:25.235446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1174-33f5-49dd-9c06-6874c42f7e68 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:25.236982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eb2e1174-33f5-49dd-9c06-6874c42f7e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:25.345358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1174-33f5-49dd-9c06-6874c42f7e68 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:25.375060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:25.421203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d6e42-8de5-4baa-9192-ddb3959dab43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:25.421897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6e42-8de5-4baa-9192-ddb3959dab43 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:25.422182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6e42-8de5-4baa-9192-ddb3959dab43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:25.422458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d6e42-8de5-4baa-9192-ddb3959dab43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:25.424130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c97d6e42-8de5-4baa-9192-ddb3959dab43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:25.535332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d6e42-8de5-4baa-9192-ddb3959dab43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:25.536977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d6e42-8de5-4baa-9192-ddb3959dab43 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:25.556287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 726/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:27.714957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3757e-0a5d-4a5f-bb5b-821bd232e50b None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:27.715527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3757e-0a5d-4a5f-bb5b-821bd232e50b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:27.715527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3757e-0a5d-4a5f-bb5b-821bd232e50b None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:27.716934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:27.722310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ff01-37ce-404f-b81f-0d1a8abfef73 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:27.722687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ff01-37ce-404f-b81f-0d1a8abfef73 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:27.722879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4ff01-37ce-404f-b81f-0d1a8abfef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:27.787555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-58b4ff01-37ce-404f-b81f-0d1a8abfef73 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:27.788765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-58b4ff01-37ce-404f-b81f-0d1a8abfef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:27.797753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:27.886840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:27.925183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3757e-0a5d-4a5f-bb5b-821bd232e50b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:27.926826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c6d3757e-0a5d-4a5f-bb5b-821bd232e50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:28.030702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3757e-0a5d-4a5f-bb5b-821bd232e50b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:28.084754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:28.104023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964ef07-e79a-4ed5-936e-19598c978b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:28.104667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964ef07-e79a-4ed5-936e-19598c978b6e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:28.104943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964ef07-e79a-4ed5-936e-19598c978b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:28.105216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964ef07-e79a-4ed5-936e-19598c978b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:28.106878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0964ef07-e79a-4ed5-936e-19598c978b6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:28.213739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964ef07-e79a-4ed5-936e-19598c978b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:28.215179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964ef07-e79a-4ed5-936e-19598c978b6e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:28.234530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 734/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:30.301053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5feccf-e038-422b-8eb6-22e0c5f9c8d3 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:30.301639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5feccf-e038-422b-8eb6-22e0c5f9c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:30.301639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5feccf-e038-422b-8eb6-22e0c5f9c8d3 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:30.303048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:30.315301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8308a-46c6-4fbc-adff-15368c681e9d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:30.315824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8308a-46c6-4fbc-adff-15368c681e9d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:30.315975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8308a-46c6-4fbc-adff-15368c681e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:30.382505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e7f8308a-46c6-4fbc-adff-15368c681e9d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:30.383697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e7f8308a-46c6-4fbc-adff-15368c681e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:30.422629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:30.481174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:01:30.518232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5feccf-e038-422b-8eb6-22e0c5f9c8d3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:30.519805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b5feccf-e038-422b-8eb6-22e0c5f9c8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:30.637587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5feccf-e038-422b-8eb6-22e0c5f9c8d3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:30.675494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:30.711069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae0f36-3796-4ca5-80ca-634b7c0d849c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:30.712334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0f36-3796-4ca5-80ca-634b7c0d849c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:30.712612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0f36-3796-4ca5-80ca-634b7c0d849c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:30.712882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae0f36-3796-4ca5-80ca-634b7c0d849c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:30.714565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c9ae0f36-3796-4ca5-80ca-634b7c0d849c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:30.822742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae0f36-3796-4ca5-80ca-634b7c0d849c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:30.824182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae0f36-3796-4ca5-80ca-634b7c0d849c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:30.843668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 729/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:32.958108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54d97-33d5-4354-a4c9-b1d88a522c6e None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:32.958649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54d97-33d5-4354-a4c9-b1d88a522c6e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:32.958649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a54d97-33d5-4354-a4c9-b1d88a522c6e None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:32.960027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:32.965858 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093da17-febd-4d1c-a6ca-7455cd7bfbba None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:32.966295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093da17-febd-4d1c-a6ca-7455cd7bfbba None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:32.966420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f093da17-febd-4d1c-a6ca-7455cd7bfbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:33.032012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f093da17-febd-4d1c-a6ca-7455cd7bfbba None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:33.033272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f093da17-febd-4d1c-a6ca-7455cd7bfbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:33.052195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:33.132255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:33.172808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54d97-33d5-4354-a4c9-b1d88a522c6e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:33.174391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e0a54d97-33d5-4354-a4c9-b1d88a522c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:33.278376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a54d97-33d5-4354-a4c9-b1d88a522c6e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:33.344966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:33.352101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b03d2b-f79f-43a4-a7ca-8be9b4265153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:33.352965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03d2b-f79f-43a4-a7ca-8be9b4265153 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:33.353248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03d2b-f79f-43a4-a7ca-8be9b4265153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:33.353547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b03d2b-f79f-43a4-a7ca-8be9b4265153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:33.355265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-83b03d2b-f79f-43a4-a7ca-8be9b4265153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:33.471254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b03d2b-f79f-43a4-a7ca-8be9b4265153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:33.472687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b03d2b-f79f-43a4-a7ca-8be9b4265153 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:33.495517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 737/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:35.685141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fad32-7002-4a40-9cf2-eec91686b2e6 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:35.685779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fad32-7002-4a40-9cf2-eec91686b2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:35.685779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08fad32-7002-4a40-9cf2-eec91686b2e6 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:35.687168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:35.692998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b064e6-5dee-415b-ad02-5d41765b9afa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:35.693486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b064e6-5dee-415b-ad02-5d41765b9afa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:35.693606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b064e6-5dee-415b-ad02-5d41765b9afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:35.761606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-93b064e6-5dee-415b-ad02-5d41765b9afa None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:35.762805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-93b064e6-5dee-415b-ad02-5d41765b9afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:35.811601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:35.860143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:35.897488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fad32-7002-4a40-9cf2-eec91686b2e6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:35.899591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b08fad32-7002-4a40-9cf2-eec91686b2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:36.003572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08fad32-7002-4a40-9cf2-eec91686b2e6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:36.053446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:36.083291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8baf88-23fa-4f20-8ed3-a5739147d55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:36.083949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8baf88-23fa-4f20-8ed3-a5739147d55d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:36.084233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8baf88-23fa-4f20-8ed3-a5739147d55d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:36.084526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8baf88-23fa-4f20-8ed3-a5739147d55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:36.086201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4a8baf88-23fa-4f20-8ed3-a5739147d55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:36.195836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8baf88-23fa-4f20-8ed3-a5739147d55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:36.197633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8baf88-23fa-4f20-8ed3-a5739147d55d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:36.217684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 732/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:45.858271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=22 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:46.215323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=66 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:55.990562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27287997-e1e3-4d40-92fc-e4ddf4eca914 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:55.991134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27287997-e1e3-4d40-92fc-e4ddf4eca914 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:55.991134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27287997-e1e3-4d40-92fc-e4ddf4eca914 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:55.992511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 739/1471] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:55.997982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40196686-eb6e-411f-8ac7-2abcebb56247 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:55.998388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40196686-eb6e-411f-8ac7-2abcebb56247 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:55.998626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40196686-eb6e-411f-8ac7-2abcebb56247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:56.064096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-40196686-eb6e-411f-8ac7-2abcebb56247 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:56.065333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-40196686-eb6e-411f-8ac7-2abcebb56247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:56.172874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 733/1472] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:56.221959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b948a-68ef-4ed2-bf6f-62d4c3487967 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:56.222245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b948a-68ef-4ed2-bf6f-62d4c3487967 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:56.222547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b948a-68ef-4ed2-bf6f-62d4c3487967 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:56.223896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 740/1473] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 14:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:56.229446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46c16-6bcd-4468-990e-127130a3c86f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:56.229813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46c16-6bcd-4468-990e-127130a3c86f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:56.230096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d46c16-6bcd-4468-990e-127130a3c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:56.304509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-00d46c16-6bcd-4468-990e-127130a3c86f None None] MFA Rules not processed for user `fbcb9f234fd740fbb644d79ef7215f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:56.305766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-00d46c16-6bcd-4468-990e-127130a3c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:56.326478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:56.383407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 734/1474] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 14:01:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:56.390867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b948a-68ef-4ed2-bf6f-62d4c3487967 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:56.392431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d2b948a-68ef-4ed2-bf6f-62d4c3487967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:56.496170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b948a-68ef-4ed2-bf6f-62d4c3487967 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:56.569959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4ec0c-06cf-4c4a-8085-fe16f1865e6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:56.570524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4ec0c-06cf-4c4a-8085-fe16f1865e6f service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:56.570810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4ec0c-06cf-4c4a-8085-fe16f1865e6f service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:56.571085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4ec0c-06cf-4c4a-8085-fe16f1865e6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:56.572772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d5d4ec0c-06cf-4c4a-8085-fe16f1865e6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:56.627076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:56.681073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4ec0c-06cf-4c4a-8085-fe16f1865e6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:56.683451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4ec0c-06cf-4c4a-8085-fe16f1865e6f service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:56.701746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 741/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:01:58.868349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857d6ba-e488-4196-b05c-dbd1d8e3c58a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:58.868910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857d6ba-e488-4196-b05c-dbd1d8e3c58a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:58.868910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857d6ba-e488-4196-b05c-dbd1d8e3c58a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:58.870448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 735/1476] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:01:58.875802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ee83-65fe-40cf-9132-67293162af0f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:58.876230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ee83-65fe-40cf-9132-67293162af0f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:58.876359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9ee83-65fe-40cf-9132-67293162af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:58.941576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-50d9ee83-65fe-40cf-9132-67293162af0f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:01:58.942796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-50d9ee83-65fe-40cf-9132-67293162af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:59.038889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 742/1477] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:01:59.061622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857d6ba-e488-4196-b05c-dbd1d8e3c58a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:01:59.063219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3857d6ba-e488-4196-b05c-dbd1d8e3c58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:01:59.191790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857d6ba-e488-4196-b05c-dbd1d8e3c58a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:01:59.241616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:01:59.287541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee976a01-6b0b-4bbb-9abd-a24b42d3a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:01:59.288204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976a01-6b0b-4bbb-9abd-a24b42d3a074 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:01:59.288488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976a01-6b0b-4bbb-9abd-a24b42d3a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:01:59.288766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976a01-6b0b-4bbb-9abd-a24b42d3a074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:01:59.289532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee976a01-6b0b-4bbb-9abd-a24b42d3a074 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:01:59.291367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-ee976a01-6b0b-4bbb-9abd-a24b42d3a074 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:01:59.291367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:01:59.291367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:01:59.292535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee976a01-6b0b-4bbb-9abd-a24b42d3a074 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:01:59.312200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 736/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 14:01:59 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:02:01.373646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517fcfd-53e1-436a-9732-07cdf50f3926 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:01.374169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517fcfd-53e1-436a-9732-07cdf50f3926 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:01.374169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517fcfd-53e1-436a-9732-07cdf50f3926 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:01.375503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 743/1479] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:02:01.380999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133307-89f8-4adf-81f8-6a814f186f50 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:01.381400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133307-89f8-4adf-81f8-6a814f186f50 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:01.381606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133307-89f8-4adf-81f8-6a814f186f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:01.448338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6c133307-89f8-4adf-81f8-6a814f186f50 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:02:01.449588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c133307-89f8-4adf-81f8-6a814f186f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:01.551795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 737/1480] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:02:01.595444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517fcfd-53e1-436a-9732-07cdf50f3926 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:02:01.597473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2517fcfd-53e1-436a-9732-07cdf50f3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:01.607729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:01.747730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517fcfd-53e1-436a-9732-07cdf50f3926 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:02:01.832659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:01.866421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653cbb4-3b13-4876-ad73-76dad5f626e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:02:01.867070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653cbb4-3b13-4876-ad73-76dad5f626e2 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:01.867381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653cbb4-3b13-4876-ad73-76dad5f626e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:01.867658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653cbb4-3b13-4876-ad73-76dad5f626e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:01.869443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e653cbb4-3b13-4876-ad73-76dad5f626e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:01.958593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653cbb4-3b13-4876-ad73-76dad5f626e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:02:01.960179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653cbb4-3b13-4876-ad73-76dad5f626e2 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:02:01.977905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 744/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:04.175690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2b92-9500-4219-861a-5d8df76efb92 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:04.176237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2b92-9500-4219-861a-5d8df76efb92 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:04.176237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a2b92-9500-4219-861a-5d8df76efb92 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:04.177682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 738/1482] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:02:04.183522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc183-418c-4710-b250-aea10bf15892 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:04.183916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc183-418c-4710-b250-aea10bf15892 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:04.184082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cc183-418c-4710-b250-aea10bf15892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:04.248878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ce0cc183-418c-4710-b250-aea10bf15892 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:02:04.250128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ce0cc183-418c-4710-b250-aea10bf15892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:04.295510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:04.345832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 745/1483] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:02:04.383158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2b92-9500-4219-861a-5d8df76efb92 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:02:04.384723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cb4a2b92-9500-4219-861a-5d8df76efb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:04.408794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:04.489238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a2b92-9500-4219-861a-5d8df76efb92 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:02:04.562518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eda52c-1c1f-4df3-a746-cd65bdf5503c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:02:04.563160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eda52c-1c1f-4df3-a746-cd65bdf5503c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:04.563438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eda52c-1c1f-4df3-a746-cd65bdf5503c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:04.563710 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eda52c-1c1f-4df3-a746-cd65bdf5503c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:04.565367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b3eda52c-1c1f-4df3-a746-cd65bdf5503c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:04.640005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:04.675900 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eda52c-1c1f-4df3-a746-cd65bdf5503c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:02:04.677398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eda52c-1c1f-4df3-a746-cd65bdf5503c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:02:04.699213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 739/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:06.817610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3301a9-a212-42aa-84ee-e74dd90e7230 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:06.818249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3301a9-a212-42aa-84ee-e74dd90e7230 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:06.818249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3301a9-a212-42aa-84ee-e74dd90e7230 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:06.819520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 746/1485] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:02:06.825782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb194ae-9c9c-4634-9171-76b1336d9b67 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:06.826271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb194ae-9c9c-4634-9171-76b1336d9b67 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:06.826383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb194ae-9c9c-4634-9171-76b1336d9b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:06.892588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-aeb194ae-9c9c-4634-9171-76b1336d9b67 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:02:06.893879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aeb194ae-9c9c-4634-9171-76b1336d9b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:06.991531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 740/1486] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:02:07.030440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3301a9-a212-42aa-84ee-e74dd90e7230 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:02:07.031963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4e3301a9-a212-42aa-84ee-e74dd90e7230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:07.143554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3301a9-a212-42aa-84ee-e74dd90e7230 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:02:07.215091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:07.216865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1dd8a-8b26-4824-b67c-eb3a68d46185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:02:07.217549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1dd8a-8b26-4824-b67c-eb3a68d46185 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:07.218041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1dd8a-8b26-4824-b67c-eb3a68d46185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:07.218365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1dd8a-8b26-4824-b67c-eb3a68d46185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:07.220465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-72a1dd8a-8b26-4824-b67c-eb3a68d46185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:07.329636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1dd8a-8b26-4824-b67c-eb3a68d46185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:02:07.331078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1dd8a-8b26-4824-b67c-eb3a68d46185 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:02:07.350094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 747/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:09.577689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd322fb-0bd1-4afd-b891-5e94507ba20a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:09.578177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd322fb-0bd1-4afd-b891-5e94507ba20a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:09.578284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd322fb-0bd1-4afd-b891-5e94507ba20a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:09.579932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 741/1488] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:02:09.585384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e8be-b73e-4c16-a69d-d3919115a5e4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:09.585799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e8be-b73e-4c16-a69d-d3919115a5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:09.585933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9e8be-b73e-4c16-a69d-d3919115a5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:09.651810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-acf9e8be-b73e-4c16-a69d-d3919115a5e4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:02:09.653027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-acf9e8be-b73e-4c16-a69d-d3919115a5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:09.707351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:09.752179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 748/1489] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:02:09.793374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd322fb-0bd1-4afd-b891-5e94507ba20a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:02:09.794988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cd322fb-0bd1-4afd-b891-5e94507ba20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:09.830936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:09.900797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd322fb-0bd1-4afd-b891-5e94507ba20a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:02:09.974989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed741853-a464-4c4b-a5ec-77adb70a00d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:02:09.975643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741853-a464-4c4b-a5ec-77adb70a00d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:09.975930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741853-a464-4c4b-a5ec-77adb70a00d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:09.976212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed741853-a464-4c4b-a5ec-77adb70a00d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:09.977893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ed741853-a464-4c4b-a5ec-77adb70a00d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:10.060658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:10.090360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed741853-a464-4c4b-a5ec-77adb70a00d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:02:10.092178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed741853-a464-4c4b-a5ec-77adb70a00d4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:02:10.110786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 742/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:12.314288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5e85-6dbd-4d00-ad49-ae8147500208 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:12.314922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5e85-6dbd-4d00-ad49-ae8147500208 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:12.314922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5e85-6dbd-4d00-ad49-ae8147500208 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:12.316232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 749/1491] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 14:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:02:12.321528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8123098-38c7-412f-8349-5bcfb84b9bdf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:12.321918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8123098-38c7-412f-8349-5bcfb84b9bdf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:12.322101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8123098-38c7-412f-8349-5bcfb84b9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:12.387875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f8123098-38c7-412f-8349-5bcfb84b9bdf None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:02:12.389015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f8123098-38c7-412f-8349-5bcfb84b9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:12.486857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 743/1492] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 14:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:02:12.527225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc5e85-6dbd-4d00-ad49-ae8147500208 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:02:12.528758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cacc5e85-6dbd-4d00-ad49-ae8147500208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:12.632531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc5e85-6dbd-4d00-ad49-ae8147500208 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:02:12.705127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844d79a-bf53-4ac2-a325-8bf9fb71438e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:02:12.705724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844d79a-bf53-4ac2-a325-8bf9fb71438e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:02:12.706000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844d79a-bf53-4ac2-a325-8bf9fb71438e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:02:12.706268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844d79a-bf53-4ac2-a325-8bf9fb71438e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:02:12.707885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8844d79a-bf53-4ac2-a325-8bf9fb71438e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:02:12.717982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:12.817753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844d79a-bf53-4ac2-a325-8bf9fb71438e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:02:12.819205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844d79a-bf53-4ac2-a325-8bf9fb71438e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:02:12.837059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 750/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:02:22.485090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=82 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:02:22.834801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=50 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:40.503504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.504100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.504100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.579480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:40.580690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:40.680356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 744/1494] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:03:40.689714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4c0e-c498-45d7-b4ce-7fbf9854597d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.690207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4c0e-c498-45d7-b4ce-7fbf9854597d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.690319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a4c0e-c498-45d7-b4ce-7fbf9854597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.764484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a38a4c0e-c498-45d7-b4ce-7fbf9854597d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:40.765652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a38a4c0e-c498-45d7-b4ce-7fbf9854597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:40.861869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 751/1495] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:03:40.866623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:40.867842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:40.884769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1187c-9967-4918-ba43-a60ccf335682 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:40.953970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:40.988944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:40.989640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.989923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.990197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.990922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:40.991226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:40.992237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:40.992237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:03:40.992237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:03:40.993129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.005269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 745/1496] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:41.013581 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a4c0e-c498-45d7-b4ce-7fbf9854597d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.022668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a4c0e-c498-45d7-b4ce-7fbf9854597d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.082958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.117252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.117949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.118229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.118503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.119196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.120903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:41.120903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: warnings.warn(msg) Jul 18 14:03:41.120903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: Jul 18 14:03:41.122796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.178583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 752/1497] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:03:41 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:03:41.182921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.184478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:41.221503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f0699-49aa-4b7a-9826-f524e74080ed admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.320950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.321568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.321846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.322115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.322801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.323801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:41.323801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:03:41.323801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:03:41.325066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.367538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 746/1498] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:03:41 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:41.371640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.373416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:41.434715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dcac0-1d60-4c53-85ac-62b0ef7e4aeb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.524067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.539328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.540006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.540280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.540545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.541296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.542336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:41.542336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: warnings.warn(msg) Jul 18 14:03:41.542336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: Jul 18 14:03:41.543910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.557911 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 753/1499] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:03:41.562040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.563577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:41.576381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a51fa-670c-4e27-a19d-d3c80332fdb5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.604058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.796515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae0627-117a-4dcd-a6d7-e2e2069ff96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.797176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae0627-117a-4dcd-a6d7-e2e2069ff96d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.797489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae0627-117a-4dcd-a6d7-e2e2069ff96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.797763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae0627-117a-4dcd-a6d7-e2e2069ff96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.798494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae0627-117a-4dcd-a6d7-e2e2069ff96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.799494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-ecae0627-117a-4dcd-a6d7-e2e2069ff96d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:41.799494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:03:41.799494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:03:41.800377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae0627-117a-4dcd-a6d7-e2e2069ff96d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.813885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 747/1500] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:03:41.818374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.819948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:41.853760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d9b85-126d-4c41-967b-f5fd4f76fb0e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.955734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab021e-42ed-438b-84c5-b74de3172004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.956625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab021e-42ed-438b-84c5-b74de3172004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.956908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab021e-42ed-438b-84c5-b74de3172004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.957184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab021e-42ed-438b-84c5-b74de3172004 admin admin] PATH_INFO: `/v3/projects/2433cc16345e4129913a05a402416ea2/users/ac30b53b0755477b962eff831f8b2199/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.979881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab021e-42ed-438b-84c5-b74de3172004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2433cc16345e4129913a05a402416ea2, user_id=ac30b53b0755477b962eff831f8b2199, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.980909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-1bab021e-42ed-438b-84c5-b74de3172004 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:41.980909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: warnings.warn(msg) Jul 18 14:03:41.980909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: Jul 18 14:03:41.983785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab021e-42ed-438b-84c5-b74de3172004 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:42.007958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 754/1501] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:03:41 2022] PUT /identity/v3/projects/2433cc16345e4129913a05a402416ea2/users/ac30b53b0755477b962eff831f8b2199/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:42.020080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f443-9452-4c81-9129-b1b9e2d66661 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.020368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f443-9452-4c81-9129-b1b9e2d66661 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.020673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09f443-9452-4c81-9129-b1b9e2d66661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.076008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fa09f443-9452-4c81-9129-b1b9e2d66661 None None] MFA Rules not processed for user `ac30b53b0755477b962eff831f8b2199`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:42.077223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fa09f443-9452-4c81-9129-b1b9e2d66661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:42.154743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 748/1502] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:03:42.167941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344c61b-5aa0-4a2f-8c45-023672b744df None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.168266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344c61b-5aa0-4a2f-8c45-023672b744df None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.168552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344c61b-5aa0-4a2f-8c45-023672b744df None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.170507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 755/1503] 10.222.0.76 () {54 vars in 964 bytes} [Mon Jul 18 14:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:42.175238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec616d-8d1e-4cca-bce0-6e34489851b3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.175528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec616d-8d1e-4cca-bce0-6e34489851b3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.175888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec616d-8d1e-4cca-bce0-6e34489851b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.208271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.253264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-73ec616d-8d1e-4cca-bce0-6e34489851b3 None None] MFA Rules not processed for user `ae320f14f9e4422aa99f91fe730cdd2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:42.254488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-73ec616d-8d1e-4cca-bce0-6e34489851b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:42.332029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 749/1504] 10.222.0.76 () {58 vars in 1061 bytes} [Mon Jul 18 14:03:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:03:42.339874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344c61b-5aa0-4a2f-8c45-023672b744df None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:42.341463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c344c61b-5aa0-4a2f-8c45-023672b744df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:42.392269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.447033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344c61b-5aa0-4a2f-8c45-023672b744df None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:42.522215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:42.522862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.523145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.523419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.525134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:42.624229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:42.625700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:42.629211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.643839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 756/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:03:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:03:42.686832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8a9a3-a24e-42b3-aecc-f3605b82b46a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.687289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8a9a3-a24e-42b3-aecc-f3605b82b46a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.687756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8a9a3-a24e-42b3-aecc-f3605b82b46a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.689848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 750/1506] 10.222.0.76 () {52 vars in 829 bytes} [Mon Jul 18 14:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:42.694790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:42.696016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:42.794626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa666a2-90fa-4257-89db-9b26d66763b4 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:42.888467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:42.889332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.889702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.889972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] PATH_INFO: `/v3/users/ac30b53b0755477b962eff831f8b2199` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.901977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac30b53b0755477b962eff831f8b2199)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:42.903089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:42.903089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: warnings.warn(msg) Jul 18 14:03:42.903089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: Jul 18 14:03:42.904518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:42.914344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.968256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac30b53b0755477b962eff831f8b2199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:42.977591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac30b53b0755477b962eff831f8b2199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:42.978061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac30b53b0755477b962eff831f8b2199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:42.996050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac30b53b0755477b962eff831f8b2199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:42.996598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac30b53b0755477b962eff831f8b2199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:43.016940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 757/1507] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:03:42 2022] DELETE /identity/v3/users/ac30b53b0755477b962eff831f8b2199 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:43.021579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.021902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.022182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.085593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:43.086759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:43.160171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:43.173274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 751/1508] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:03:43.182911 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.184231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:43.283448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81829a-026f-4368-a9b1-d4badc328a58 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:43.346288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:43.367438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a4341-37b2-425d-96db-ac575cca011a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.368089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a4341-37b2-425d-96db-ac575cca011a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.368393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a4341-37b2-425d-96db-ac575cca011a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.368664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a4341-37b2-425d-96db-ac575cca011a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.370345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2a1a4341-37b2-425d-96db-ac575cca011a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:43.478811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a4341-37b2-425d-96db-ac575cca011a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:43.480257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a4341-37b2-425d-96db-ac575cca011a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:43.499331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 758/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:03:43.829273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.830553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:43.842193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0340e-1bab-4f66-992f-d7f23a170293 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:43.940842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.941729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.942013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.942288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] PATH_INFO: `/v3/projects/2433cc16345e4129913a05a402416ea2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.952475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2433cc16345e4129913a05a402416ea2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:43.953525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:03:43.953525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:03:43.953525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:03:43.954726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:44.011886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2433cc16345e4129913a05a402416ea2', 'request_id': 'req-88662c14-25e5-4b03-8efa-2dbdb97bf111'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:44.023204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2433cc16345e4129913a05a402416ea2', 'request_id': 'req-88662c14-25e5-4b03-8efa-2dbdb97bf111'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:44.029717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2433cc16345e4129913a05a402416ea2', 'request_id': 'req-88662c14-25e5-4b03-8efa-2dbdb97bf111'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:44.058833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] The token cache is being invalidate because project 2433cc16345e4129913a05a402416ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:03:44.059121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:44.060269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-88662c14-25e5-4b03-8efa-2dbdb97bf111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:03:44.061668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 752/1510] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:03:43 2022] DELETE /identity/v3/projects/2433cc16345e4129913a05a402416ea2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:53.497693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=62 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:54.056833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:35.856281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb544c-4f18-4136-a76e-59511c959765 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:35.856933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb544c-4f18-4136-a76e-59511c959765 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:35.856933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb544c-4f18-4136-a76e-59511c959765 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:35.858247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:35.863855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f81508-3374-4e7c-98e4-b8fc726dcf34 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:35.864322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f81508-3374-4e7c-98e4-b8fc726dcf34 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:35.864429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f81508-3374-4e7c-98e4-b8fc726dcf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:35.944674 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-29f81508-3374-4e7c-98e4-b8fc726dcf34 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:35.945940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29f81508-3374-4e7c-98e4-b8fc726dcf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:36.056925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:36.217294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb544c-4f18-4136-a76e-59511c959765 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:36.219668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a4bb544c-4f18-4136-a76e-59511c959765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:36.339695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb544c-4f18-4136-a76e-59511c959765 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:36.345318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7f7b8-4208-4cf1-813a-eb58dcd717b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:36.345986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7f7b8-4208-4cf1-813a-eb58dcd717b6 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:36.346269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7f7b8-4208-4cf1-813a-eb58dcd717b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:36.346547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7f7b8-4208-4cf1-813a-eb58dcd717b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:36.354680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7f7b8-4208-4cf1-813a-eb58dcd717b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:36.356264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7f7b8-4208-4cf1-813a-eb58dcd717b6 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:36.366288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 760/1513] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:05:37.200112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a700-783c-4bc4-a570-012eba84e82f None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:37.200630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a700-783c-4bc4-a570-012eba84e82f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:37.200747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5a700-783c-4bc4-a570-012eba84e82f None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:37.202061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:37.207442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0515-d243-42c3-9ce8-430b6cae2869 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:37.207887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0515-d243-42c3-9ce8-430b6cae2869 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:37.208011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed0515-d243-42c3-9ce8-430b6cae2869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:37.225800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1bed0515-d243-42c3-9ce8-430b6cae2869 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:37.226993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1bed0515-d243-42c3-9ce8-430b6cae2869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:37.235576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:37.389634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a700-783c-4bc4-a570-012eba84e82f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:37.403979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5a700-783c-4bc4-a570-012eba84e82f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:37.410692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2db9-4d8d-4e92-ad5c-03c3af5d1193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:37.411326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2db9-4d8d-4e92-ad5c-03c3af5d1193 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:37.411610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2db9-4d8d-4e92-ad5c-03c3af5d1193 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:37.411886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2db9-4d8d-4e92-ad5c-03c3af5d1193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:37.419924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec2db9-4d8d-4e92-ad5c-03c3af5d1193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:37.422406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec2db9-4d8d-4e92-ad5c-03c3af5d1193 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:37.432556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 755/1516] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:05:38.126642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34df49-b416-4629-a099-3059df2ed099 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:38.126930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34df49-b416-4629-a099-3059df2ed099 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:38.127207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34df49-b416-4629-a099-3059df2ed099 None None] PATH_INFO: `/v3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:38.128529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 762/1517] 10.222.0.74 () {54 vars in 925 bytes} [Mon Jul 18 14:05:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:38.145174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185922df-ab9f-44bc-bde6-7e77fe4fc2e6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:38.145513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185922df-ab9f-44bc-bde6-7e77fe4fc2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:38.145798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185922df-ab9f-44bc-bde6-7e77fe4fc2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:38.204096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-185922df-ab9f-44bc-bde6-7e77fe4fc2e6 None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:38.205305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-185922df-ab9f-44bc-bde6-7e77fe4fc2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:38.221932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:38.278155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 756/1518] 10.222.0.74 () {58 vars in 1015 bytes} [Mon Jul 18 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:47.221188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=56 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:47.807388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e894-3101-45a8-a6d2-428705c0adab None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:47.807595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e894-3101-45a8-a6d2-428705c0adab None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:47.807868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32e894-3101-45a8-a6d2-428705c0adab None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:47.809244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 763/1519] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 14:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:47.814255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d6d3-d766-4c0b-bfb1-f14c5c48b1a5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:47.814739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d6d3-d766-4c0b-bfb1-f14c5c48b1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:47.814847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d6d3-d766-4c0b-bfb1-f14c5c48b1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:47.833996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fa44d6d3-d766-4c0b-bfb1-f14c5c48b1a5 None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:47.835224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fa44d6d3-d766-4c0b-bfb1-f14c5c48b1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:47.844898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 757/1520] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:47.852190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32e894-3101-45a8-a6d2-428705c0adab None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:47.867484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32e894-3101-45a8-a6d2-428705c0adab None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:47.872779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cc4b4-1919-4d7b-8226-b8e42b313084 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:47.873461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc4b4-1919-4d7b-8226-b8e42b313084 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:47.873746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc4b4-1919-4d7b-8226-b8e42b313084 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:47.874078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc4b4-1919-4d7b-8226-b8e42b313084 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:47.883167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cc4b4-1919-4d7b-8226-b8e42b313084 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:47.884880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4cc4b4-1919-4d7b-8226-b8e42b313084 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:47.895172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 764/1521] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:05:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:05:48.692677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b930-1b58-4812-86aa-b11589df8b1a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:48.692965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b930-1b58-4812-86aa-b11589df8b1a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:48.693244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0b930-1b58-4812-86aa-b11589df8b1a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:48.694942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:48.699957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad54c-d9d8-4a08-a613-fd486127a4f9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:48.700430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad54c-d9d8-4a08-a613-fd486127a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:48.700550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ad54c-d9d8-4a08-a613-fd486127a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:48.724249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-625ad54c-d9d8-4a08-a613-fd486127a4f9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:48.725497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-625ad54c-d9d8-4a08-a613-fd486127a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:48.733772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:48.892992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0b930-1b58-4812-86aa-b11589df8b1a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:48.908189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0b930-1b58-4812-86aa-b11589df8b1a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:48.913551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256436af-12f4-4d10-adbb-81e09db9de37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:48.914186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256436af-12f4-4d10-adbb-81e09db9de37 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:48.914462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256436af-12f4-4d10-adbb-81e09db9de37 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:48.914733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256436af-12f4-4d10-adbb-81e09db9de37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:48.922852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256436af-12f4-4d10-adbb-81e09db9de37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:48.924415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256436af-12f4-4d10-adbb-81e09db9de37 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:48.933679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 759/1524] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:05:49.773243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d559-1257-4c3a-a3d1-ddb48c504e81 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:49.773844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d559-1257-4c3a-a3d1-ddb48c504e81 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:49.773844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d559-1257-4c3a-a3d1-ddb48c504e81 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:49.775178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:49.780729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb12dd-63bc-4091-b4cd-b4dc420729d1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:49.781046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb12dd-63bc-4091-b4cd-b4dc420729d1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:49.781471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb12dd-63bc-4091-b4cd-b4dc420729d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:49.799103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b4fb12dd-63bc-4091-b4cd-b4dc420729d1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:49.800298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b4fb12dd-63bc-4091-b4cd-b4dc420729d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:49.808074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:49.960113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531d559-1257-4c3a-a3d1-ddb48c504e81 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:49.975411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531d559-1257-4c3a-a3d1-ddb48c504e81 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:49.980870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc0938-9d50-4f2b-b2b0-1694c6af1991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:49.981550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc0938-9d50-4f2b-b2b0-1694c6af1991 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:49.981836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc0938-9d50-4f2b-b2b0-1694c6af1991 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:49.982116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc0938-9d50-4f2b-b2b0-1694c6af1991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:49.990485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc0938-9d50-4f2b-b2b0-1694c6af1991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:49.992066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc0938-9d50-4f2b-b2b0-1694c6af1991 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:50.001571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 767/1527] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:05:54.155807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362263ee-028a-44e7-9365-04a5d98ed6c7 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:54.156409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362263ee-028a-44e7-9365-04a5d98ed6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:54.156409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362263ee-028a-44e7-9365-04a5d98ed6c7 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:54.157781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:54.163113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea4579-4098-4a9f-aae8-6896704cbf72 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:54.163559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea4579-4098-4a9f-aae8-6896704cbf72 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:54.163662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea4579-4098-4a9f-aae8-6896704cbf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:54.182848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-adea4579-4098-4a9f-aae8-6896704cbf72 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:54.184070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-adea4579-4098-4a9f-aae8-6896704cbf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:54.192516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:54.231206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362263ee-028a-44e7-9365-04a5d98ed6c7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:54.232922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-362263ee-028a-44e7-9365-04a5d98ed6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:54.313852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362263ee-028a-44e7-9365-04a5d98ed6c7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:54.318002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23a601-92ff-4e3b-9dff-7bb2cea2bc02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:54.318665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a601-92ff-4e3b-9dff-7bb2cea2bc02 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:54.318952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a601-92ff-4e3b-9dff-7bb2cea2bc02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:54.319974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23a601-92ff-4e3b-9dff-7bb2cea2bc02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:54.329149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23a601-92ff-4e3b-9dff-7bb2cea2bc02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:54.330623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23a601-92ff-4e3b-9dff-7bb2cea2bc02 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:54.340358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 762/1530] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:05:56.365479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8c58-9bdc-4f6f-bbb3-7c813ced30a6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:56.366033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8c58-9bdc-4f6f-bbb3-7c813ced30a6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:56.366033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8c58-9bdc-4f6f-bbb3-7c813ced30a6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:56.367373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:56.372621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d3803-26eb-4d8a-9947-a721b95b4536 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:56.373061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d3803-26eb-4d8a-9947-a721b95b4536 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:56.373167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d3803-26eb-4d8a-9947-a721b95b4536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:56.393188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6f9d3803-26eb-4d8a-9947-a721b95b4536 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:56.394713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6f9d3803-26eb-4d8a-9947-a721b95b4536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:56.403579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:05:56.439865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8c58-9bdc-4f6f-bbb3-7c813ced30a6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:56.450907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8c58-9bdc-4f6f-bbb3-7c813ced30a6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:56.455286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bc05c-a8b0-4a86-942c-65681e05546e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:56.455918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc05c-a8b0-4a86-942c-65681e05546e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:56.456193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc05c-a8b0-4a86-942c-65681e05546e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:56.456463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bc05c-a8b0-4a86-942c-65681e05546e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:56.465587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc05c-a8b0-4a86-942c-65681e05546e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:56.466995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bc05c-a8b0-4a86-942c-65681e05546e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:56.477026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 770/1533] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:06:00.075587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8776f-622d-49f5-921f-9b0aa110a4eb None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:00.076325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8776f-622d-49f5-921f-9b0aa110a4eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:00.076325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8776f-622d-49f5-921f-9b0aa110a4eb None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:00.078167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:00.083564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8cd8-1798-438e-bff3-6eaa8454d9b6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:00.084012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8cd8-1798-438e-bff3-6eaa8454d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:00.084123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec8cd8-1798-438e-bff3-6eaa8454d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:00.101874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8cec8cd8-1798-438e-bff3-6eaa8454d9b6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:00.103059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8cec8cd8-1798-438e-bff3-6eaa8454d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:00.111377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:06:00.412068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8776f-622d-49f5-921f-9b0aa110a4eb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:00.413776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-27c8776f-622d-49f5-921f-9b0aa110a4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:00.479198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:00.493520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8776f-622d-49f5-921f-9b0aa110a4eb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:00.497074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0069-da5c-4a9f-a01c-2c4712257a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:00.497751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0069-da5c-4a9f-a01c-2c4712257a6f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:00.498039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0069-da5c-4a9f-a01c-2c4712257a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:00.498317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0069-da5c-4a9f-a01c-2c4712257a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:00.508180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0069-da5c-4a9f-a01c-2c4712257a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:00.509637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0069-da5c-4a9f-a01c-2c4712257a6f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:00.519150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 765/1536] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:06:02.617592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34721ef-d172-4797-8374-b238e8f65274 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:02.618170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34721ef-d172-4797-8374-b238e8f65274 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:02.618170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34721ef-d172-4797-8374-b238e8f65274 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:02.619496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:02.625475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd290-3918-4783-9fa1-b8495868c345 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:02.625864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd290-3918-4783-9fa1-b8495868c345 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:02.626028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd290-3918-4783-9fa1-b8495868c345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:02.643278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2f6fd290-3918-4783-9fa1-b8495868c345 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:02.644469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2f6fd290-3918-4783-9fa1-b8495868c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:02.652463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:06:02.962243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34721ef-d172-4797-8374-b238e8f65274 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:02.963962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f34721ef-d172-4797-8374-b238e8f65274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:02.977114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34721ef-d172-4797-8374-b238e8f65274 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:02.980622 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48213d1-31e4-4b05-a8f7-ef38c8ccdfa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:02.981286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48213d1-31e4-4b05-a8f7-ef38c8ccdfa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:02.981597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48213d1-31e4-4b05-a8f7-ef38c8ccdfa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:02.981875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48213d1-31e4-4b05-a8f7-ef38c8ccdfa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:02.991174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48213d1-31e4-4b05-a8f7-ef38c8ccdfa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:02.992592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48213d1-31e4-4b05-a8f7-ef38c8ccdfa5 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:03.002632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 773/1539] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:06:12.638644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=11 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:12.997869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=33 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:45.549007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c460-7e97-4c3a-8378-04886e827ee0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.549690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c460-7e97-4c3a-8378-04886e827ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.549690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c460-7e97-4c3a-8378-04886e827ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.581960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7b51c460-7e97-4c3a-8378-04886e827ee0 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:45.583299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7b51c460-7e97-4c3a-8378-04886e827ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:45.592731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 767/1540] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:45.602688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2a296-3dfe-4cd6-8039-ad31f2d6631b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.603383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2a296-3dfe-4cd6-8039-ad31f2d6631b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.603383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2a296-3dfe-4cd6-8039-ad31f2d6631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.643876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fef2a296-3dfe-4cd6-8039-ad31f2d6631b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:45.645032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fef2a296-3dfe-4cd6-8039-ad31f2d6631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:45.659631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 774/1541] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:45.664198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c460-7e97-4c3a-8378-04886e827ee0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:45.679242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c460-7e97-4c3a-8378-04886e827ee0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:45.686369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:45.687419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.687914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.688408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.689144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:45.689486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:45.691451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:45.705759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519af7-f4fd-4cd3-ab07-58644b4ef61c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.706111 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519af7-f4fd-4cd3-ab07-58644b4ef61c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.706321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a519af7-f4fd-4cd3-ab07-58644b4ef61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.714414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 768/1542] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:45.722192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:45.737763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d3127-9eab-4697-86b4-c40bf39851c7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:45.746478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7a519af7-f4fd-4cd3-ab07-58644b4ef61c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:45.748549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7a519af7-f4fd-4cd3-ab07-58644b4ef61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:45.750728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad8385-a751-41f0-b768-63f2880850ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:45.752034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad8385-a751-41f0-b768-63f2880850ec admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.752456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad8385-a751-41f0-b768-63f2880850ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.752742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad8385-a751-41f0-b768-63f2880850ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.753471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad8385-a751-41f0-b768-63f2880850ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:45.754623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-e8ad8385-a751-41f0-b768-63f2880850ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:07:45.754623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:07:45.754623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:07:45.755827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad8385-a751-41f0-b768-63f2880850ec admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:45.767912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 775/1543] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:07:45.771091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4f754-e304-4f3c-b0b3-68efcb6937d7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.771493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4f754-e304-4f3c-b0b3-68efcb6937d7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.771776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4f754-e304-4f3c-b0b3-68efcb6937d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.805247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-73b4f754-e304-4f3c-b0b3-68efcb6937d7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:45.806750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-73b4f754-e304-4f3c-b0b3-68efcb6937d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:45.821114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 776/1544] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:07:45.822794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7d50a-fd8f-4b19-90c9-f8cdc8411fbe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.823308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7d50a-fd8f-4b19-90c9-f8cdc8411fbe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.824034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7d50a-fd8f-4b19-90c9-f8cdc8411fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.828086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 769/1545] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:07:45.829556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b061f-e3f7-4883-93d5-655bb4c4215f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.829841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b061f-e3f7-4883-93d5-655bb4c4215f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.830115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b061f-e3f7-4883-93d5-655bb4c4215f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.860207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-57a7d50a-fd8f-4b19-90c9-f8cdc8411fbe None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:45.866210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-57a7d50a-fd8f-4b19-90c9-f8cdc8411fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:45.867291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0d8b061f-e3f7-4883-93d5-655bb4c4215f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:45.868537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0d8b061f-e3f7-4883-93d5-655bb4c4215f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:45.963535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 770/1546] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:45.964418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b061f-e3f7-4883-93d5-655bb4c4215f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:45.980171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b061f-e3f7-4883-93d5-655bb4c4215f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:45.983254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 777/1547] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:45.984905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5377c-6e38-4c3d-b8fa-8d5da5090671 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.985188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5377c-6e38-4c3d-b8fa-8d5da5090671 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.985496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5377c-6e38-4c3d-b8fa-8d5da5090671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.990037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcaa175-efbd-4430-b9b8-b877daf0a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:45.990920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa175-efbd-4430-b9b8-b877daf0a7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:45.991204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa175-efbd-4430-b9b8-b877daf0a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:45.991479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcaa175-efbd-4430-b9b8-b877daf0a7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:45.992181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaa175-efbd-4430-b9b8-b877daf0a7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:45.994162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcaa175-efbd-4430-b9b8-b877daf0a7a5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.006262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1eb5377c-6e38-4c3d-b8fa-8d5da5090671 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.007816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1eb5377c-6e38-4c3d-b8fa-8d5da5090671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.026757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 771/1548] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/users => generated 290 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.027065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 778/1549] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.029140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255641cf-5324-4e85-87c6-ff1441cee055 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.029743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255641cf-5324-4e85-87c6-ff1441cee055 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.030167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255641cf-5324-4e85-87c6-ff1441cee055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.034375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154be23-f937-47b0-bc0f-4a945d9985bc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.034670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154be23-f937-47b0-bc0f-4a945d9985bc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.035018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154be23-f937-47b0-bc0f-4a945d9985bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.052410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-255641cf-5324-4e85-87c6-ff1441cee055 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.053812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2154be23-f937-47b0-bc0f-4a945d9985bc None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.053952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-255641cf-5324-4e85-87c6-ff1441cee055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.054979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2154be23-f937-47b0-bc0f-4a945d9985bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.063496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 779/1550] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.063896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 772/1551] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.065076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec1de5-5002-48e9-96a1-44833274819c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.065208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86240d69-a7a7-40b8-a278-28dc1c3f2452 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.065462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86240d69-a7a7-40b8-a278-28dc1c3f2452 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.065740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86240d69-a7a7-40b8-a278-28dc1c3f2452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.065943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec1de5-5002-48e9-96a1-44833274819c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.066361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec1de5-5002-48e9-96a1-44833274819c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.092256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-86240d69-a7a7-40b8-a278-28dc1c3f2452 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.094004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-86240d69-a7a7-40b8-a278-28dc1c3f2452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.096067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-21ec1de5-5002-48e9-96a1-44833274819c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.097544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-21ec1de5-5002-48e9-96a1-44833274819c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.101861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 773/1552] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.102649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86240d69-a7a7-40b8-a278-28dc1c3f2452 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.111152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 780/1553] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.112457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a83a-5069-43c4-8101-46c82d9e0a5a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.112760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a83a-5069-43c4-8101-46c82d9e0a5a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.113049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120a83a-5069-43c4-8101-46c82d9e0a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.113939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86240d69-a7a7-40b8-a278-28dc1c3f2452 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.122714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.124055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.124366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.124650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.125450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.125760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.127372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.134645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f120a83a-5069-43c4-8101-46c82d9e0a5a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.135855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f120a83a-5069-43c4-8101-46c82d9e0a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.140091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 774/1554] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.140809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.148944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 781/1555] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.150080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a83a-5069-43c4-8101-46c82d9e0a5a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.160033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ce100-3046-4b9f-9cc3-0da5a504d246 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.160653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120a83a-5069-43c4-8101-46c82d9e0a5a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.164700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc696f-7d17-4d90-954b-aea6f241c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.165390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.165546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc696f-7d17-4d90-954b-aea6f241c44b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.165652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc696f-7d17-4d90-954b-aea6f241c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.165930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc696f-7d17-4d90-954b-aea6f241c44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.166048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.166312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.166588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.166699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc696f-7d17-4d90-954b-aea6f241c44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.167311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.167628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.168243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc696f-7d17-4d90-954b-aea6f241c44b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.168626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:07:46.168626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: warnings.warn(msg) Jul 18 14:07:46.168626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: Jul 18 14:07:46.170298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53f539-40e2-4459-b23d-efa4a6210d88 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.179748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 775/1556] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:46.180818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574c088-011c-4b9c-9b4b-a5086de41e93 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.181107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574c088-011c-4b9c-9b4b-a5086de41e93 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.181402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574c088-011c-4b9c-9b4b-a5086de41e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.189442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 782/1557] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.190782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4899f-b9c8-482b-bc45-c7870cca96d0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.191070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4899f-b9c8-482b-bc45-c7870cca96d0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.191348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4899f-b9c8-482b-bc45-c7870cca96d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.199487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c574c088-011c-4b9c-9b4b-a5086de41e93 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.200860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c574c088-011c-4b9c-9b4b-a5086de41e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.208801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 776/1558] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.212432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a1e4899f-b9c8-482b-bc45-c7870cca96d0 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.212537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574c088-011c-4b9c-9b4b-a5086de41e93 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.212645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a1e4899f-b9c8-482b-bc45-c7870cca96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.220009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574c088-011c-4b9c-9b4b-a5086de41e93 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.220156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 783/1559] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.221433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e9ea-adbc-4e7e-a06e-16775a702853 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.221720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e9ea-adbc-4e7e-a06e-16775a702853 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.221993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e9ea-adbc-4e7e-a06e-16775a702853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.228394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.229093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.229410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.229692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.230459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.230765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.233047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.240957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ff70e9ea-adbc-4e7e-a06e-16775a702853 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.242234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ff70e9ea-adbc-4e7e-a06e-16775a702853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.245279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 777/1560] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.246250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.255313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 784/1561] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.256144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaad158-1c8f-464f-a579-b383f3fc86f7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.256679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9e5c8-02c5-4d58-8df9-82e177fa9acf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.256970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9e5c8-02c5-4d58-8df9-82e177fa9acf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.257271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9e5c8-02c5-4d58-8df9-82e177fa9acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.263412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.264101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.264357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.264793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.265324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.267287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.276569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2bf9e5c8-02c5-4d58-8df9-82e177fa9acf None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.277792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2bf9e5c8-02c5-4d58-8df9-82e177fa9acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.287303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 785/1562] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:46.291080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9e5c8-02c5-4d58-8df9-82e177fa9acf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.294930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 778/1563] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.298038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9e5c8-02c5-4d58-8df9-82e177fa9acf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.298993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.312093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.356297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.357123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.357428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.357732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.358452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.360110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.363008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95abb7c-2b41-474b-8a96-d2d57877af48 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.367655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.368311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.368596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.368875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.369592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.373329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 786/1564] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:46.373329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.373615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.380591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66465f-691a-41e9-8d20-7589ecf95d5e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.385222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.386006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.386642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.386642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.387376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.387593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.389987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.398877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 779/1565] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.400013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.406797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 787/1566] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.407924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.414437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.419501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451210e-79b3-4d8a-b7e2-c7dcdbdde8c7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.470528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd553836-3ef6-4554-82b5-4aa52b35a6fd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.475132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.475825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.475996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.476130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.476375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.476657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.476942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.477131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.477250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.477473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.477929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.479090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.479814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.491786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 780/1567] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.492683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.503672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07800dae-f6ba-4aac-8c7d-89c87dd5ea23 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.509811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 788/1568] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.509811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.512045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.513367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.513731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.514012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.514751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.515060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.516670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.529395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 781/1569] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.530272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.540981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcd463-244e-46b4-81c7-8c998dd912f2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.574500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cd62b-1431-487e-8be0-4fc838665a27 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.580093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.580750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.581030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.581371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.582100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.582405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.584000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.596191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 789/1570] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.603443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.603984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.603984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.603984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.603984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.604575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.604692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.610665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd73e7f-8372-4a7c-80c9-374fd1462022 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.615769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.616689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.616981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.617248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] PATH_INFO: `/v3/projects/ce69efee9752466b97200c148d998bb7/users/e8cdb0d44b9948fc8712e8752c067abe/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.627973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 782/1571] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.628906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.633929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce69efee9752466b97200c148d998bb7, user_id=e8cdb0d44b9948fc8712e8752c067abe, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.636492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.641197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64354059-8fb0-4618-a9b6-323218372c25 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.646911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.647571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.647854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.648133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.648816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.650759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.651176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 790/1572] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:46 2022] PUT /identity/v3/projects/ce69efee9752466b97200c148d998bb7/users/e8cdb0d44b9948fc8712e8752c067abe/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:46.652050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.660586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.676498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 783/1573] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/users => generated 303 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.677171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.688707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a8e90-4def-429d-a054-23573d11f2c7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.719315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9ea69-9f22-4c11-b361-d3972565aa1d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.724033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.724626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.724904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.725174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.725887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.727791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.730993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.751815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.752487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.752770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.753710 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.754416 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.754811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 791/1574] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.755684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.756463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.785381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 784/1575] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.785381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.824797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e95da2-330c-4710-970b-e08dc0ee9079 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.846591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60d595-c654-4c04-8144-6dc96c30ec59 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.851115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.851770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.852048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.852324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.853005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.854930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.881598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 785/1576] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.882481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.886522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.887226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.887512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.888350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.889048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.890438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:07:46.890438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: warnings.warn(msg) Jul 18 14:07:46.890438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: Jul 18 14:07:46.891659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.911643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 792/1577] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.912797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.924359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f114c74-2569-4d06-91f9-f4fa4ba600e2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.950194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63f168-14b4-43de-bff0-4e743543c956 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.955662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbe991-82be-41e8-aa3e-a75a9daae8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.956329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe991-82be-41e8-aa3e-a75a9daae8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.956608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe991-82be-41e8-aa3e-a75a9daae8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.956883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe991-82be-41e8-aa3e-a75a9daae8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.957628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe991-82be-41e8-aa3e-a75a9daae8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.959540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe991-82be-41e8-aa3e-a75a9daae8dc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.963615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.987331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.988006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.988314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.988555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.989159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 786/1578] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:46.990576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f05f9-c845-4de8-a61f-091d87290bb9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.990871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f05f9-c845-4de8-a61f-091d87290bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.991151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f05f9-c845-4de8-a61f-091d87290bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.992401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.994068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.004950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 793/1579] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.006180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.016567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54edb4e-6ae7-4922-a137-6e6503c5dcfc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.019989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-462f05f9-c845-4de8-a61f-091d87290bb9 None None] MFA Rules not processed for user `e8cdb0d44b9948fc8712e8752c067abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:47.021193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-462f05f9-c845-4de8-a61f-091d87290bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:47.030029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:47.077972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.078769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.079055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.079334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.080101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.081878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.090006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 787/1580] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:47.091514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f05f9-c845-4de8-a61f-091d87290bb9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.096019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 794/1581] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.096019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.105275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f05f9-c845-4de8-a61f-091d87290bb9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.105602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be5a330-f7ac-42d2-b934-0a0f446a2f68 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.110245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.110395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.110901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.111014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.111186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.111290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.111458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.111565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.112140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.112244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.114077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.114198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.139138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 788/1582] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:47.139138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.139441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 795/1583] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:47.139441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.147739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db088-a798-4fba-b575-983b249d1616 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.147902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c802-72f8-4618-a3c6-bf0430132888 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.152320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.152471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.152964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.153129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.154078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.154170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.154257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.154359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.154866 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.155204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.156458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.157095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.167487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 796/1584] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.168443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.178934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 789/1585] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:47.179113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dc5dd-fd10-4f5e-bed5-e1e8fcf34fc0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.179674 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.186650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.187322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.187605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.187884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.188714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.189202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af15a76-a803-43aa-a2a7-c86ec5336951 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.191029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.194065 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.194705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.194983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.195254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.195997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.197603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.209141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 790/1586] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.210036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.216775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 797/1587] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:47.217844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.221144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccadb7e-8077-47f2-987b-276a84db0ee8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.225931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.226612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.226893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.227166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.227411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c8829-50f2-471a-8aa3-854e5eb62d10 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.227852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.229818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.232372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.233025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.233312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.233621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.234381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.236000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.246142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 798/1588] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.247019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.259302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 791/1589] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:47.259464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa28b-3702-4807-9f20-daab86142f02 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.259573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.315544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.316251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.316531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.316814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.317571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.319441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.319820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fbe32-2c1b-441f-ae64-544509766b67 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.325763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.326500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.326790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.327073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.327810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.329462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.330532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 799/1590] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.331105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.340876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839bf9e-c1d6-4182-b88e-388a280d6d5f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.345487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 792/1591] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.345487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.345972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.346630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.346915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.347194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.347919 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.349540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.349765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:47.353841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e14d3-81e0-4321-958e-cc0fde41cf9e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.360007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.360407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 800/1592] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.360698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.360983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.361203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.361318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.362209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.363817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.370613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76064107-699b-41f3-bcc6-f1fcef4dd710 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.378007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 793/1593] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.378007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.380716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.381544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.381828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.382107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] PATH_INFO: `/v3/projects/247dc0c1f278403e9188fafe45202e32/users/887e53c1e74543ce914f94c0b2666fe4/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.391684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9c212-115f-4f1f-8c6e-5321d212c6f0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.396673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.398017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.398344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.400131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.400250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] RBAC: Authorizing `identity:create_grant(project_id=247dc0c1f278403e9188fafe45202e32, user_id=887e53c1e74543ce914f94c0b2666fe4, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.400363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.400962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.402045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.413743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 794/1594] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.417533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 801/1595] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:47 2022] PUT /identity/v3/projects/247dc0c1f278403e9188fafe45202e32/users/887e53c1e74543ce914f94c0b2666fe4/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:47.417824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.418304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.431757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50429f63-4fbb-4590-8f87-aca8beba4873 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.442577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:47.488390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36043f67-a6f0-40d0-b0e2-552363ee455d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.489708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.490599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.490878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.491152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] PATH_INFO: `/v3/projects/8945a97c092c452b91d787fef31f30d3/users/6dafaf801780465da29d71745a7b69b6/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.493215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.493795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.494078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.494366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.495038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.497061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.505926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8945a97c092c452b91d787fef31f30d3, user_id=6dafaf801780465da29d71745a7b69b6, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.507130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:07:47.507130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:07:47.507130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:07:47.509287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.521805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 802/1596] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:47.521805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.523032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 795/1597] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:47 2022] PUT /identity/v3/projects/8945a97c092c452b91d787fef31f30d3/users/6dafaf801780465da29d71745a7b69b6/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:47.523843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.530656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3f360-b99c-49cf-85f0-d53c397562aa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.587501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af13b2-8533-4cb3-b1ca-5b76b966c701 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.587852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.588522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.588803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.589078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.589840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.591946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.593041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.593745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.594055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.594312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.595045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.596640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.601868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 803/1598] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.602649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.613382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 796/1599] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.613382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.614621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b8c04-15e1-469c-b2ed-7d1816cb8ccb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.619401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9465b45-57a0-415f-a0b4-2048f2cea229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.620662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465b45-57a0-415f-a0b4-2048f2cea229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.620976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465b45-57a0-415f-a0b4-2048f2cea229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.621271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9465b45-57a0-415f-a0b4-2048f2cea229 admin admin] PATH_INFO: `/v3/projects/ee7438a05a0e4840934d90146499dd85/users/0217a62228cb44b6888bb79821d9ca1c/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.621406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568349cb-3d02-4090-8e99-ea3e3c046b6e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.626544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.627196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.627484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.627769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.628503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.630158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.636822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9465b45-57a0-415f-a0b4-2048f2cea229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7438a05a0e4840934d90146499dd85, user_id=0217a62228cb44b6888bb79821d9ca1c, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.640231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9465b45-57a0-415f-a0b4-2048f2cea229 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.640668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 797/1600] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.641492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.651691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5794-177b-4fcb-a8e4-fa371fdf073a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.654661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 804/1601] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:47 2022] PUT /identity/v3/projects/ee7438a05a0e4840934d90146499dd85/users/0217a62228cb44b6888bb79821d9ca1c/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:47.655929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766173d-e5c3-4fe6-a93f-b8410c67a7ba None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.656736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766173d-e5c3-4fe6-a93f-b8410c67a7ba None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.656736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766173d-e5c3-4fe6-a93f-b8410c67a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.681731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5766173d-e5c3-4fe6-a93f-b8410c67a7ba None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:47.682966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5766173d-e5c3-4fe6-a93f-b8410c67a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:47.704243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:47.717973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.718793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.719176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.719462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.720194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.721862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.732193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 798/1602] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.732995 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.742308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7e4e-0a5f-496e-9c51-3c67be564bb7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.745416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 805/1603] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:47.746829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21a69e-ffef-486c-989d-c0445ac1d78c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.747928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21a69e-ffef-486c-989d-c0445ac1d78c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.748330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21a69e-ffef-486c-989d-c0445ac1d78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.750238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.750919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.751160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.751418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.752154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.753979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.765013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 799/1604] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:47.765843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.768867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3b21a69e-ffef-486c-989d-c0445ac1d78c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:47.770114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3b21a69e-ffef-486c-989d-c0445ac1d78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:47.775531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2892aa8-bbf5-4258-baa4-21fd9f7c1cf9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.777803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 806/1605] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:47.778763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21a69e-ffef-486c-989d-c0445ac1d78c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.780448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.781582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.781848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.782130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] PATH_INFO: `/v3/projects/cd06c4b28780464d8be23fd8cc91c6f6/users/7a19653742d646768e715adccd8add38/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.790532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21a69e-ffef-486c-989d-c0445ac1d78c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.795964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c0700-cd89-479f-b4d6-6b02d33dad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.797879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0700-cd89-479f-b4d6-6b02d33dad37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.798161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0700-cd89-479f-b4d6-6b02d33dad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.798443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c0700-cd89-479f-b4d6-6b02d33dad37 admin admin] PATH_INFO: `/v3/projects/7d82b1caebf34cbdb6c4cfeeaa30ce7d/users/371340721cfc4b778ec39ccc167172e5/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.801602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd06c4b28780464d8be23fd8cc91c6f6, user_id=7a19653742d646768e715adccd8add38, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.804342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.812595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:47.816693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c0700-cd89-479f-b4d6-6b02d33dad37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d82b1caebf34cbdb6c4cfeeaa30ce7d, user_id=371340721cfc4b778ec39ccc167172e5, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.819292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 800/1606] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:47 2022] PUT /identity/v3/projects/cd06c4b28780464d8be23fd8cc91c6f6/users/7a19653742d646768e715adccd8add38/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:47.820241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.820416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c0700-cd89-479f-b4d6-6b02d33dad37 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.837288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 807/1607] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:47 2022] PUT /identity/v3/projects/7d82b1caebf34cbdb6c4cfeeaa30ce7d/users/371340721cfc4b778ec39ccc167172e5/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:47.838900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ed41-5b24-43e9-9490-5fc17951122c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.839505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ed41-5b24-43e9-9490-5fc17951122c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.839957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715ed41-5b24-43e9-9490-5fc17951122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.868465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b715ed41-5b24-43e9-9490-5fc17951122c None None] MFA Rules not processed for user `0217a62228cb44b6888bb79821d9ca1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:47.869714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b715ed41-5b24-43e9-9490-5fc17951122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:47.888342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb8c5b-2820-4449-9702-8108f5ea9f39 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.937601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 808/1608] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:47.938339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ed41-5b24-43e9-9490-5fc17951122c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:47.947116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.948020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.948298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.948572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] PATH_INFO: `/v3/projects/0f6178c87705428a9e3986ed0a1f517e/users/ab8bc4faa499494f93571797e3c89e84/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.964636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f6178c87705428a9e3986ed0a1f517e, user_id=ab8bc4faa499494f93571797e3c89e84, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.968375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.983762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 801/1609] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:47 2022] PUT /identity/v3/projects/0f6178c87705428a9e3986ed0a1f517e/users/ab8bc4faa499494f93571797e3c89e84/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:47.986547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.006092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715ed41-5b24-43e9-9490-5fc17951122c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.030766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:48.043236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c975a-befa-446d-97fc-b26f232ef6ed admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.047832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.048516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.048797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.049083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.063960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.064845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.065120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.065418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] PATH_INFO: `/v3/projects/67082d4d077846508617d3be1f39244b/users/54537fcfff814c969edacfa5364901c4/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.080509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=67082d4d077846508617d3be1f39244b, user_id=54537fcfff814c969edacfa5364901c4, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.083546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.099798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 809/1610] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:47 2022] PUT /identity/v3/projects/67082d4d077846508617d3be1f39244b/users/54537fcfff814c969edacfa5364901c4/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:48.100683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.111583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:48.125961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.127418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.136867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 802/1611] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:48.138241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.145927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4505-f0fa-47ac-a202-5ab5554c7fd0 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.173456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a652ae-88b3-401e-b254-4069dfa8d2cd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.178836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d641f0-aa0f-4ea6-bf46-31768e9b088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.179724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d641f0-aa0f-4ea6-bf46-31768e9b088e admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.180054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d641f0-aa0f-4ea6-bf46-31768e9b088e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.180268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d641f0-aa0f-4ea6-bf46-31768e9b088e admin admin] PATH_INFO: `/v3/projects/3dceb04cc94a45fcaab4dc1e395bfb02/users/df28f2eadb0743eb8e2125c7027e3481/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.197158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d641f0-aa0f-4ea6-bf46-31768e9b088e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dceb04cc94a45fcaab4dc1e395bfb02, user_id=df28f2eadb0743eb8e2125c7027e3481, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.200430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d641f0-aa0f-4ea6-bf46-31768e9b088e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.203087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9dea6-e950-443f-8c1d-248a0e3b5bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.203817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9dea6-e950-443f-8c1d-248a0e3b5bff service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.204321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9dea6-e950-443f-8c1d-248a0e3b5bff service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.204718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9dea6-e950-443f-8c1d-248a0e3b5bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.216333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9dea6-e950-443f-8c1d-248a0e3b5bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.218160 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 810/1612] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:48 2022] PUT /identity/v3/projects/3dceb04cc94a45fcaab4dc1e395bfb02/users/df28f2eadb0743eb8e2125c7027e3481/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:48.219234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393e788-9eeb-41b5-b105-6e239b0d7142 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.219511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393e788-9eeb-41b5-b105-6e239b0d7142 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.219806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393e788-9eeb-41b5-b105-6e239b0d7142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.221287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9dea6-e950-443f-8c1d-248a0e3b5bff service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.235833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 803/1613] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:48.237190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631df9e-c8d1-4208-8ba6-c0fa46ac9b8c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.237522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631df9e-c8d1-4208-8ba6-c0fa46ac9b8c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.237791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631df9e-c8d1-4208-8ba6-c0fa46ac9b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.251705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1393e788-9eeb-41b5-b105-6e239b0d7142 None None] MFA Rules not processed for user `7a19653742d646768e715adccd8add38`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:48.252972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1393e788-9eeb-41b5-b105-6e239b0d7142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:48.258709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5631df9e-c8d1-4208-8ba6-c0fa46ac9b8c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:48.259931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5631df9e-c8d1-4208-8ba6-c0fa46ac9b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:48.328663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 811/1614] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:48.329523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393e788-9eeb-41b5-b105-6e239b0d7142 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.344801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 804/1615] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:48.350010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfe89b-b20c-4e99-9b15-107a2a2ee055 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.350462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfe89b-b20c-4e99-9b15-107a2a2ee055 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.350943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfe89b-b20c-4e99-9b15-107a2a2ee055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.372330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f3cfe89b-b20c-4e99-9b15-107a2a2ee055 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:48.373651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f3cfe89b-b20c-4e99-9b15-107a2a2ee055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:48.381779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 805/1616] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:48.382898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c21-a67a-470f-9c9e-de29723b80ec None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.383183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c21-a67a-470f-9c9e-de29723b80ec None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.383458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b9c21-a67a-470f-9c9e-de29723b80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.405897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393e788-9eeb-41b5-b105-6e239b0d7142 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.411567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.412530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.413130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.413638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.414541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.416920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.418107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8d5b9c21-a67a-470f-9c9e-de29723b80ec None None] MFA Rules not processed for user `54537fcfff814c969edacfa5364901c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:48.420284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d5b9c21-a67a-470f-9c9e-de29723b80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:48.440942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:48.452298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 812/1617] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:48.468742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.481738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:48.503430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 806/1618] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:48.503430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9c21-a67a-470f-9c9e-de29723b80ec None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.517498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b9c21-a67a-470f-9c9e-de29723b80ec None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.548134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab558aa-8ec0-4063-a144-fd6d9585b4ad admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.554416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.555247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.555763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.556267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.557225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.560628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.579820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 813/1619] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:48.581438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.584385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:48.645734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.647567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.648994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.649557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.651516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.656153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.682662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec233b9-4412-4d2d-ba56-346b5c61c594 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.690233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.691200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.692481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.692844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.706339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.708187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.712832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 807/1620] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:48.712832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.721826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 814/1621] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:48.722826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.733253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ec22e-0b2f-4110-8b28-96d4e9dcd578 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.789475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d5a46-e75d-4233-a736-cc487ae17534 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.796027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b930876-bc70-4502-ab88-93356a90d8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.797301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930876-bc70-4502-ab88-93356a90d8eb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.798062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930876-bc70-4502-ab88-93356a90d8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.798559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930876-bc70-4502-ab88-93356a90d8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.805595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.806708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.807045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.807329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.808345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.811984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.815164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b930876-bc70-4502-ab88-93356a90d8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.817193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b930876-bc70-4502-ab88-93356a90d8eb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.833549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 808/1622] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:48.835266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bc2f-8cb9-4774-9ed2-61165f5c5c38 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.835619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bc2f-8cb9-4774-9ed2-61165f5c5c38 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.835903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bc2f-8cb9-4774-9ed2-61165f5c5c38 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.838250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 809/1623] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 14:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:48.839050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1bc2f-8cb9-4774-9ed2-61165f5c5c38 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.842752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 815/1624] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:48.847039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.858232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1bc2f-8cb9-4774-9ed2-61165f5c5c38 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.859684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab9ece-d3fb-42f7-977b-a1084f17dee0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.863350 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112128c4-37f4-475c-9cdf-26b7bd454355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.865027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112128c4-37f4-475c-9cdf-26b7bd454355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.865443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112128c4-37f4-475c-9cdf-26b7bd454355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.865745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:48.865870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112128c4-37f4-475c-9cdf-26b7bd454355 admin admin] PATH_INFO: `/v3/projects/3dceb04cc94a45fcaab4dc1e395bfb02/users/df28f2eadb0743eb8e2125c7027e3481/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.866418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.866768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.867063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.868015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.868592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112128c4-37f4-475c-9cdf-26b7bd454355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dceb04cc94a45fcaab4dc1e395bfb02, user_id=df28f2eadb0743eb8e2125c7027e3481, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:48.870826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.871418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112128c4-37f4-475c-9cdf-26b7bd454355 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:48.884829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 810/1625] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:48 2022] PUT /identity/v3/projects/3dceb04cc94a45fcaab4dc1e395bfb02/users/df28f2eadb0743eb8e2125c7027e3481/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:48.886692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98cfda-d388-4041-bc09-7fbe35e7618f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.887068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98cfda-d388-4041-bc09-7fbe35e7618f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.888462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98cfda-d388-4041-bc09-7fbe35e7618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.941742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 816/1626] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:48.946606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:48.954490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6d98cfda-d388-4041-bc09-7fbe35e7618f None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:48.955896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6d98cfda-d388-4041-bc09-7fbe35e7618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:48.969841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551a142-9498-4071-bffd-148666349a48 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:48.978011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:49.005004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:49.105912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 811/1627] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:49.108902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1a3c-3ec4-4374-9e01-c6ebab13fa7e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.109201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1a3c-3ec4-4374-9e01-c6ebab13fa7e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.110601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af1a3c-3ec4-4374-9e01-c6ebab13fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.115400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.116861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.117514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.118101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.119538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.123913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.142383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-89af1a3c-3ec4-4374-9e01-c6ebab13fa7e None None] MFA Rules not processed for user `df28f2eadb0743eb8e2125c7027e3481`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:49.143916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89af1a3c-3ec4-4374-9e01-c6ebab13fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:49.145912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 817/1628] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:49.147674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.175224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69330b71-e81a-4eb4-a0c9-23a1b8ecb6e6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.180476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.181511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.181511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.181711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.182432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.184791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.201062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 818/1629] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:49.202143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.219243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bdfdc-ebaf-469c-8755-f0058a3a493b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.227454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.228200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.229052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.229360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.251236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 812/1630] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:49.252298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1a3c-3ec4-4374-9e01-c6ebab13fa7e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.272574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af1a3c-3ec4-4374-9e01-c6ebab13fa7e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.284011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.285060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.285429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.286000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] PATH_INFO: `/v3/projects/4cb303f9a05042ff91d0ed8cdc7d7706/users/a792abd184874d40bc31c79e2ee6c17c/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.313460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb303f9a05042ff91d0ed8cdc7d7706, user_id=a792abd184874d40bc31c79e2ee6c17c, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.316328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.345081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.347992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.354593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 813/1631] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:49 2022] PUT /identity/v3/projects/4cb303f9a05042ff91d0ed8cdc7d7706/users/a792abd184874d40bc31c79e2ee6c17c/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:49.354593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.366916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 819/1632] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:49.385436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.472351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e7bf-badf-44f4-a55f-ac4cc1128157 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.481035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.484005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.484005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.484187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] PATH_INFO: `/v3/projects/5cc6ffaee43f443cac809762962f0cd8/users/6859c3a6ab744c068bad78139835566b/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.523896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc6ffaee43f443cac809762962f0cd8, user_id=6859c3a6ab744c068bad78139835566b, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.524971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec72d97-9295-4c71-a68b-7fe621300d7a service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.528926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.539761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:49.565510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 814/1633] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:49 2022] PUT /identity/v3/projects/5cc6ffaee43f443cac809762962f0cd8/users/6859c3a6ab744c068bad78139835566b/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:49.566468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.658709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.659385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.659667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.659942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.662963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6df89-c201-4cdc-bdf3-e1b7d9711830 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.669642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ece9ad-4499-4570-b076-a8a97a8a1d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.669895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece9ad-4499-4570-b076-a8a97a8a1d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.670380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece9ad-4499-4570-b076-a8a97a8a1d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.670679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ece9ad-4499-4570-b076-a8a97a8a1d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.671432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ece9ad-4499-4570-b076-a8a97a8a1d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.673119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ece9ad-4499-4570-b076-a8a97a8a1d00 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.689479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 815/1634] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:49.690284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:49.690778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee4df-5fd0-4326-bf47-05ce2ab0241a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.690778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee4df-5fd0-4326-bf47-05ce2ab0241a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.690778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee4df-5fd0-4326-bf47-05ce2ab0241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.720430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db0ee4df-5fd0-4326-bf47-05ce2ab0241a None None] MFA Rules not processed for user `6dafaf801780465da29d71745a7b69b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:49.721704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db0ee4df-5fd0-4326-bf47-05ce2ab0241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:49.756052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.757715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.768904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 820/1635] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:49.769964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.781266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf11b72-cbc0-4561-a4f7-72ca99671b4e service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.786476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.787296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.787676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.788051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.789574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.791528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.807387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 821/1636] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:49.807387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.819490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c731-0a24-445f-a801-37ee3d7fccc5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.825974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.827181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.827563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.827938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] PATH_INFO: `/v3/projects/4cb303f9a05042ff91d0ed8cdc7d7706/users/a792abd184874d40bc31c79e2ee6c17c/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.830251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb303f9a05042ff91d0ed8cdc7d7706, user_id=a792abd184874d40bc31c79e2ee6c17c, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.834145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.854024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 816/1638] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:49.854977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ee4df-5fd0-4326-bf47-05ce2ab0241a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.865078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 822/1638] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:49 2022] PUT /identity/v3/projects/4cb303f9a05042ff91d0ed8cdc7d7706/users/a792abd184874d40bc31c79e2ee6c17c/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:49.868062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.893431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ee4df-5fd0-4326-bf47-05ce2ab0241a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.052161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea82e10-8f40-4cf1-947b-21909e614018 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.060271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c32470-1fc6-4e3c-833e-de8cfde768aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.066133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32470-1fc6-4e3c-833e-de8cfde768aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.066658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32470-1fc6-4e3c-833e-de8cfde768aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.067153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32470-1fc6-4e3c-833e-de8cfde768aa admin admin] PATH_INFO: `/v3/projects/5cc6ffaee43f443cac809762962f0cd8/users/6859c3a6ab744c068bad78139835566b/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.067513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacde708-53c7-47e2-961e-97642b386a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.068471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacde708-53c7-47e2-961e-97642b386a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.068801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacde708-53c7-47e2-961e-97642b386a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.069081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacde708-53c7-47e2-961e-97642b386a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.071639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacde708-53c7-47e2-961e-97642b386a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.074299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c32470-1fc6-4e3c-833e-de8cfde768aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc6ffaee43f443cac809762962f0cd8, user_id=6859c3a6ab744c068bad78139835566b, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.074956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacde708-53c7-47e2-961e-97642b386a6b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.079817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c32470-1fc6-4e3c-833e-de8cfde768aa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.108893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 817/1639] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:49 2022] PUT /identity/v3/projects/5cc6ffaee43f443cac809762962f0cd8/users/6859c3a6ab744c068bad78139835566b/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:50.114719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb1ee-2cea-43e2-a18d-fabfda3f96a9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.116526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb1ee-2cea-43e2-a18d-fabfda3f96a9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.116921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb1ee-2cea-43e2-a18d-fabfda3f96a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.124057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 823/1640] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:49 2022] POST /identity/v3/projects => generated 401 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:50.126228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d7dc-8978-49f4-af9a-2d731508fb57 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.126740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d7dc-8978-49f4-af9a-2d731508fb57 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.127274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d7dc-8978-49f4-af9a-2d731508fb57 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.129333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 824/1641] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 14:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:50.131028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f54b7-f13a-42fb-835f-138810f67549 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.131689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f54b7-f13a-42fb-835f-138810f67549 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.132152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f54b7-f13a-42fb-835f-138810f67549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.173005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-861f54b7-f13a-42fb-835f-138810f67549 None None] MFA Rules not processed for user `6859c3a6ab744c068bad78139835566b`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:50.174765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-861f54b7-f13a-42fb-835f-138810f67549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:50.191358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c3cbb1ee-2cea-43e2-a18d-fabfda3f96a9 None None] MFA Rules not processed for user `a792abd184874d40bc31c79e2ee6c17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:50.193488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c3cbb1ee-2cea-43e2-a18d-fabfda3f96a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:50.199499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:50.297955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:50.328720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 825/1642] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:50.332733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f54b7-f13a-42fb-835f-138810f67549 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:50.366711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 818/1643] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:50.375542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01060c-9dd4-44db-987e-26b26dd571ae None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.375542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01060c-9dd4-44db-987e-26b26dd571ae None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.375542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01060c-9dd4-44db-987e-26b26dd571ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.414440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8c01060c-9dd4-44db-987e-26b26dd571ae None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:50.419527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c01060c-9dd4-44db-987e-26b26dd571ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:50.466714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f54b7-f13a-42fb-835f-138810f67549 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.475726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.476023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.476413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.476758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.477564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.480354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.507981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 826/1644] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:07:50 2022] POST /identity/v3/users => generated 307 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:50.509128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:50.572316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 819/1645] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:50.579646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01060c-9dd4-44db-987e-26b26dd571ae None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:50.595454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fc341-c010-4fe9-a47c-37182a720e27 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.600298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.600972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.601255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.602454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.616837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.619236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.634829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 827/1646] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:50.636281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:50.658120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554fa56-295b-49d0-a44a-10495fafb794 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.678458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.679191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.680430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.680611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.681740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.686501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.713594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01060c-9dd4-44db-987e-26b26dd571ae None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.717760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 828/1647] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:50.722714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:50.726646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.729171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.732131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.733127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.750552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac26457-d6af-4400-8efc-0afe57af0e7a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.754586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.756831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.772090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.773000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.773273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.773571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] PATH_INFO: `/v3/projects/5d3384da5cb041a0ae1681630da7bfbc/users/a4a656b1d4ce4a8697a3b27d6deb516e/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.774179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 820/1648] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:50.802104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3384da5cb041a0ae1681630da7bfbc, user_id=a4a656b1d4ce4a8697a3b27d6deb516e, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.805938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.837779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 829/1649] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:50 2022] PUT /identity/v3/projects/5d3384da5cb041a0ae1681630da7bfbc/users/a4a656b1d4ce4a8697a3b27d6deb516e/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:50.838985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:50.848207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:50.864009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082270-b6fb-4d56-ac45-590a8a10ebcd service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.925550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:50.963534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:50.973216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.974152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.974707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.975139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:50.976056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:50.979427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:50.986078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9f60-e8e0-41f9-b7c0-88e80fbb8090 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:50.993802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df28f2eadb0743eb8e2125c7027e3481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dceb04cc94a45fcaab4dc1e395bfb02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:50.994832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:50.995214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:50.996082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 821/1650] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:50.998299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.000179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.001846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:51.002072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.005624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.029950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 830/1651] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:51.039023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.057389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252c97-33dc-4838-ab08-565b76b03412 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.064217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.065229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.065617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.066214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] PATH_INFO: `/v3/projects/5d3384da5cb041a0ae1681630da7bfbc/users/a4a656b1d4ce4a8697a3b27d6deb516e/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.068654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3384da5cb041a0ae1681630da7bfbc, user_id=a4a656b1d4ce4a8697a3b27d6deb516e, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.072598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.099938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 831/1652] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:07:51 2022] PUT /identity/v3/projects/5d3384da5cb041a0ae1681630da7bfbc/users/a4a656b1d4ce4a8697a3b27d6deb516e/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:51.099938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.110058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65276d-c00e-4b8d-ab35-162f4618006f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.226403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.227693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.228175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.228869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.264161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d51d28-89f7-4e0a-981b-e2b5c6d354e2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.284230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df28f2eadb0743eb8e2125c7027e3481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dceb04cc94a45fcaab4dc1e395bfb02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.290186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.291671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.292312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.295569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.304222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.373638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.373900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 832/1653] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:07:51 2022] POST /identity/v3/projects => generated 354 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:51.378634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.378905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.445178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 822/1654] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:51.447947 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.486463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613466f5-33ff-4566-abf3-485267709aae service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.572070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7db522-490d-4e41-b2c6-2011666d5f9f tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.585568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.587282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.587411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:51.589056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.595202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.697177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df28f2eadb0743eb8e2125c7027e3481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dceb04cc94a45fcaab4dc1e395bfb02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.701813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.703486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.703815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.712832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:51.713304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.717494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.745042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.749198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.756824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 823/1655] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:51.799189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 833/1656] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:52.259443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:52.326835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59bb66-0120-4245-a329-8a4fea1f601a tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:52.326835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df28f2eadb0743eb8e2125c7027e3481', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dceb04cc94a45fcaab4dc1e395bfb02', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:52.326835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:52.332485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:52.332485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] PATH_INFO: `/v3/projects/e766a9de52c9475aabe9d3b9621855b2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:52.332485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e766a9de52c9475aabe9d3b9621855b2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:52.333037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:52.458095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e766a9de52c9475aabe9d3b9621855b2', 'request_id': 'req-32ea0548-3061-4575-9ec9-8a805e009c85'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:52.476296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e766a9de52c9475aabe9d3b9621855b2', 'request_id': 'req-32ea0548-3061-4575-9ec9-8a805e009c85'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:52.493339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e766a9de52c9475aabe9d3b9621855b2', 'request_id': 'req-32ea0548-3061-4575-9ec9-8a805e009c85'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:52.563312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] The token cache is being invalidate because project e766a9de52c9475aabe9d3b9621855b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:07:52.564309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:52.565391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:52.583854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 824/1657] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:07:52 2022] DELETE /identity/v3/projects/e766a9de52c9475aabe9d3b9621855b2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:53.147174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:53.152506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:53.156262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:53.178426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:53.336295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127da33-12b3-4cc6-9410-1908d70c926f service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:53.348252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:53.350641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:53.352059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:53.352350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] PATH_INFO: `/v3/users/7a19653742d646768e715adccd8add38` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:53.357933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a19653742d646768e715adccd8add38)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:53.364291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:53.369872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea0548-3061-4575-9ec9-8a805e009c85 tempest-VolumeQuotaClassesTest-397573505 tempest-VolumeQuotaClassesTest-397573505-project-admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:53.384856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:53.387685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:53.389294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:53.389995 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] PATH_INFO: `/v3/users/e8cdb0d44b9948fc8712e8752c067abe` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:53.392073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cdb0d44b9948fc8712e8752c067abe)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:53.393271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: WARNING py.warnings [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:07:53.393271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: warnings.warn(msg) Jul 18 14:07:53.393271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: Jul 18 14:07:53.395508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:53.524330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a19653742d646768e715adccd8add38'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.550492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a19653742d646768e715adccd8add38'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.550492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a19653742d646768e715adccd8add38'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.607641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a19653742d646768e715adccd8add38'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.609382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-916f807f-7bef-496a-b485-b1334f998753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a19653742d646768e715adccd8add38'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.668046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 834/1658] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:07:53 2022] DELETE /identity/v3/users/7a19653742d646768e715adccd8add38 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:07:53.670133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec91d1-e6a0-43d6-a4ec-0125b5f5b1f6 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:53.670998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec91d1-e6a0-43d6-a4ec-0125b5f5b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:53.672349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec91d1-e6a0-43d6-a4ec-0125b5f5b1f6 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:53.680734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 835/1659] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 14:07:53 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:53.685717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cdb0d44b9948fc8712e8752c067abe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.690299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55704cde-6a70-4366-bcc6-e497118ff4b3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:53.695590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55704cde-6a70-4366-bcc6-e497118ff4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:53.696933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55704cde-6a70-4366-bcc6-e497118ff4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:53.734726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:53.783104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cdb0d44b9948fc8712e8752c067abe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.785035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cdb0d44b9948fc8712e8752c067abe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.788796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cdb0d44b9948fc8712e8752c067abe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.802536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-55704cde-6a70-4366-bcc6-e497118ff4b3 None None] MFA Rules not processed for user `a4a656b1d4ce4a8697a3b27d6deb516e`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:53.805939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-55704cde-6a70-4366-bcc6-e497118ff4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:53.825885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c74dce6-e942-4dc5-a2e7-c4fb19c5eb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cdb0d44b9948fc8712e8752c067abe'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:53.942012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 825/1660] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:07:53 2022] DELETE /identity/v3/users/e8cdb0d44b9948fc8712e8752c067abe => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:53.946239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c16995-8cd8-41b3-9425-55a3ec120a76 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:53.946541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c16995-8cd8-41b3-9425-55a3ec120a76 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:53.946822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c16995-8cd8-41b3-9425-55a3ec120a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.020564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 836/1661] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:54.028832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639b9a2-d160-43d1-ac8f-a14c2d854e19 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.031763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c0c16995-8cd8-41b3-9425-55a3ec120a76 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:54.032187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639b9a2-d160-43d1-ac8f-a14c2d854e19 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.032568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639b9a2-d160-43d1-ac8f-a14c2d854e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.040638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c0c16995-8cd8-41b3-9425-55a3ec120a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:54.084711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e639b9a2-d160-43d1-ac8f-a14c2d854e19 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:54.087156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e639b9a2-d160-43d1-ac8f-a14c2d854e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:54.108525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:54.200637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 826/1662] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:54.202786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e287e-5c76-4da5-8752-f0b2a783a59f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.204729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e287e-5c76-4da5-8752-f0b2a783a59f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.205262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e287e-5c76-4da5-8752-f0b2a783a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.243729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 837/1663] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:54.251400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403f55-edaa-461b-bd2d-3fb3056eebc8 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.251786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403f55-edaa-461b-bd2d-3fb3056eebc8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.252166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9403f55-edaa-461b-bd2d-3fb3056eebc8 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.253855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 838/1664] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 14:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:07:54.254229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-656e287e-5c76-4da5-8752-f0b2a783a59f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:54.257044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403f55-edaa-461b-bd2d-3fb3056eebc8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:54.257960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-656e287e-5c76-4da5-8752-f0b2a783a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:54.258961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b9403f55-edaa-461b-bd2d-3fb3056eebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:54.279537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 827/1665] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:54.281270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.281791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.282219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.321773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:54.323368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:54.350966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 828/1666] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:54.365250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:54.367254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:54.410431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9403f55-edaa-461b-bd2d-3fb3056eebc8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:54.421887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:54.424149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.427134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.427479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.454030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:54.455599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:54.491725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 839/1667] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:54.493918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:54.532008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d37bae-f973-41ee-98fc-6e4f4db13dc4 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:54.534531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819cec3f-0ffd-4cfc-9441-50a2e5242bf1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:54.543047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f27454-9843-4bc4-b48e-c54f80b5bf44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:54.543785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f27454-9843-4bc4-b48e-c54f80b5bf44 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.544196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f27454-9843-4bc4-b48e-c54f80b5bf44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.544461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f27454-9843-4bc4-b48e-c54f80b5bf44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.546179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34302487-c447-4ba8-93d2-fc7ccedfec73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:54.546844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34302487-c447-4ba8-93d2-fc7ccedfec73 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.547122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34302487-c447-4ba8-93d2-fc7ccedfec73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.547394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34302487-c447-4ba8-93d2-fc7ccedfec73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.595284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f27454-9843-4bc4-b48e-c54f80b5bf44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:54.596295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34302487-c447-4ba8-93d2-fc7ccedfec73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:54.597811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34302487-c447-4ba8-93d2-fc7ccedfec73 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:54.600099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f27454-9843-4bc4-b48e-c54f80b5bf44 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:54.638846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 840/1668] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:54.640083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 829/1669] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:07:56.967849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdead4-fe50-4bec-a580-6bb23c2b37b1 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:56.969407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdead4-fe50-4bec-a580-6bb23c2b37b1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:56.969832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdead4-fe50-4bec-a580-6bb23c2b37b1 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:56.972601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 841/1670] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:07:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:56.990667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c152-f0c1-4f6c-8f33-c7c27ba04358 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:56.994394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c152-f0c1-4f6c-8f33-c7c27ba04358 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:56.995035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368c152-f0c1-4f6c-8f33-c7c27ba04358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:57.064513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6368c152-f0c1-4f6c-8f33-c7c27ba04358 None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:57.069641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6368c152-f0c1-4f6c-8f33-c7c27ba04358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:57.197943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:57.242621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 830/1671] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:07:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:57.294393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df484-f6d4-4e81-abed-62d6ce87b322 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:57.294662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df484-f6d4-4e81-abed-62d6ce87b322 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:57.294986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df484-f6d4-4e81-abed-62d6ce87b322 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:57.297314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 842/1672] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 14:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:57.305003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:57.305656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:57.306034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:57.352253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:57.354051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:57.377081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644df484-f6d4-4e81-abed-62d6ce87b322 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:57.378205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 831/1673] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:07:57.419097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644df484-f6d4-4e81-abed-62d6ce87b322 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:57.437818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:57.438883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:57.440652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:57.441863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:57.501252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:57.504117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:57.559741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 843/1674] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:07:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:07:57.938561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:57.940252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:57.971047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc363bd-6788-40db-8e7d-1cff3a9ffb2d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:57.971283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:57.971283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:57.977067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:57.977977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:57.978258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:57.978528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] PATH_INFO: `/v3/projects/ce69efee9752466b97200c148d998bb7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:57.980593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce69efee9752466b97200c148d998bb7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:57.986748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:57.988930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d3c1e-4935-406c-a615-2067dcf2b677 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:57.995832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:57.997090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:57.997630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:57.998009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] PATH_INFO: `/v3/projects/cd06c4b28780464d8be23fd8cc91c6f6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:57.999388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd06c4b28780464d8be23fd8cc91c6f6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:58.000508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: WARNING py.warnings [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:07:58.000508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: warnings.warn(msg) Jul 18 14:07:58.000508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: Jul 18 14:07:58.001982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:58.104314 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce69efee9752466b97200c148d998bb7', 'request_id': 'req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.124758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce69efee9752466b97200c148d998bb7', 'request_id': 'req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.133166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce69efee9752466b97200c148d998bb7', 'request_id': 'req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.156223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] The token cache is being invalidate because project ce69efee9752466b97200c148d998bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:07:58.156512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.160213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.162785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 832/1675] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:07:57 2022] DELETE /identity/v3/projects/ce69efee9752466b97200c148d998bb7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:58.168215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:58.174222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:58.207734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd06c4b28780464d8be23fd8cc91c6f6', 'request_id': 'req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.242186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd06c4b28780464d8be23fd8cc91c6f6', 'request_id': 'req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.263844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd06c4b28780464d8be23fd8cc91c6f6', 'request_id': 'req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.330349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] The token cache is being invalidate because project cd06c4b28780464d8be23fd8cc91c6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:07:58.330608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.331282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.334255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 844/1676] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:07:57 2022] DELETE /identity/v3/projects/cd06c4b28780464d8be23fd8cc91c6f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:58.338695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:58.340669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:58.341290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f45b6-9bb1-47c8-95d1-e3dbdeabe5d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:58.370556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:58.476293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:58.477832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:58.478443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:58.478892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] PATH_INFO: `/v3/users/df28f2eadb0743eb8e2125c7027e3481` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:58.482091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df28f2eadb0743eb8e2125c7027e3481)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:58.491469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:58.497175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb9e81-3c69-4dc2-9cd1-5bf1a67a4d48 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:58.509775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:58.511399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:58.511735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:58.512867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] PATH_INFO: `/v3/users/6859c3a6ab744c068bad78139835566b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:58.515760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6859c3a6ab744c068bad78139835566b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:58.526715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:58.546753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:58.626768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df28f2eadb0743eb8e2125c7027e3481'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.648017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df28f2eadb0743eb8e2125c7027e3481'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.648890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df28f2eadb0743eb8e2125c7027e3481'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.650535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df28f2eadb0743eb8e2125c7027e3481'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.653718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6859c3a6ab744c068bad78139835566b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.665707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df28f2eadb0743eb8e2125c7027e3481'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.674420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6859c3a6ab744c068bad78139835566b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.675367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6859c3a6ab744c068bad78139835566b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.708162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6859c3a6ab744c068bad78139835566b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.711157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4ea93d64-577c-40b6-bf88-93cebd9cfecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6859c3a6ab744c068bad78139835566b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:07:58.724556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 833/1677] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:07:58 2022] DELETE /identity/v3/users/df28f2eadb0743eb8e2125c7027e3481 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:07:58.737060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 845/1678] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:07:58 2022] DELETE /identity/v3/users/6859c3a6ab744c068bad78139835566b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:07:59.853077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:59.854618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:00.010311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286a242-d16f-4501-8efb-e5266282001c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:00.127860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351acc-e6ba-482a-89a3-74c33040574f None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:00.128340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351acc-e6ba-482a-89a3-74c33040574f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:00.128340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad351acc-e6ba-482a-89a3-74c33040574f None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:00.130121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 846/1679] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:08:00.143537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351acc-e6ba-482a-89a3-74c33040574f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:00.145767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad351acc-e6ba-482a-89a3-74c33040574f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:00.174140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:00.175055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:00.175339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:00.175614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] PATH_INFO: `/v3/users/54537fcfff814c969edacfa5364901c4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:00.179016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=54537fcfff814c969edacfa5364901c4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:00.180978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:00.217447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad351acc-e6ba-482a-89a3-74c33040574f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:00.231301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:00.236014 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:00.236371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:00.236653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] PATH_INFO: `/v3/users/6dafaf801780465da29d71745a7b69b6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:00.238190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dafaf801780465da29d71745a7b69b6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:00.240163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:00.309508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:00.313591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54537fcfff814c969edacfa5364901c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.330991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54537fcfff814c969edacfa5364901c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.331815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54537fcfff814c969edacfa5364901c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.333939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54537fcfff814c969edacfa5364901c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.350695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7804ff04-75cf-439f-9459-1b73ec6dbc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54537fcfff814c969edacfa5364901c4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.394528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dafaf801780465da29d71745a7b69b6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.400227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 834/1680] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:07:59 2022] DELETE /identity/v3/users/54537fcfff814c969edacfa5364901c4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:00.406035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:00.406640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:00.407120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:00.408513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dafaf801780465da29d71745a7b69b6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.409520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dafaf801780465da29d71745a7b69b6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.428764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dafaf801780465da29d71745a7b69b6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.430962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a97e60b-f9c3-4b87-af75-0d9781b11d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dafaf801780465da29d71745a7b69b6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.453111 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:00.464225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 847/1681] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:00 2022] DELETE /identity/v3/users/6dafaf801780465da29d71745a7b69b6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:00.468550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:00.470184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:00.471521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:00.495096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] MFA Rules not processed for user `ecddc5e9b4e140ff817284acb38d9801`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:00.501164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:00.527081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:00.529858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:00.745038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 848/1682] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:00.748281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:00.751096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:00.755673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 835/1683] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:08:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:00.781432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:00.783059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:00.788025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75050ca-c62a-473f-a8ea-c1c565b8c7da None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:00.810838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:00.811901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:00.812411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367db6a3-5e80-4ffe-ae2f-5281fcfd998d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:00.813469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:00.813905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] PATH_INFO: `/v3/projects/3dceb04cc94a45fcaab4dc1e395bfb02` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:00.817144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dceb04cc94a45fcaab4dc1e395bfb02)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:00.823318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:00.835783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:00.838500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:00.840365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:00.842914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] PATH_INFO: `/v3/projects/5cc6ffaee43f443cac809762962f0cd8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:00.844532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc6ffaee43f443cac809762962f0cd8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:00.864497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:00.945319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dceb04cc94a45fcaab4dc1e395bfb02', 'request_id': 'req-fb799902-5219-4838-bcbe-17c468d6edcb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.963301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dceb04cc94a45fcaab4dc1e395bfb02', 'request_id': 'req-fb799902-5219-4838-bcbe-17c468d6edcb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:00.985735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dceb04cc94a45fcaab4dc1e395bfb02', 'request_id': 'req-fb799902-5219-4838-bcbe-17c468d6edcb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.004811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc6ffaee43f443cac809762962f0cd8', 'request_id': 'req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.011265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] The token cache is being invalidate because project 3dceb04cc94a45fcaab4dc1e395bfb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:01.011572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.014136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.023510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 849/1684] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:00 2022] DELETE /identity/v3/projects/3dceb04cc94a45fcaab4dc1e395bfb02 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:01.024318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc6ffaee43f443cac809762962f0cd8', 'request_id': 'req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.033205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc6ffaee43f443cac809762962f0cd8', 'request_id': 'req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.038042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.042551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.072040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] The token cache is being invalidate because project 5cc6ffaee43f443cac809762962f0cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:01.075202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.079802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:01.082718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 836/1685] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:00 2022] DELETE /identity/v3/projects/5cc6ffaee43f443cac809762962f0cd8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:01.083624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.090740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.175399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:01.207397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4db0f1-9bc3-4922-a9e8-4c0bd54d2882 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.214738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c76df-e8e5-4f5d-9528-7257f5e0102b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.216342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c76df-e8e5-4f5d-9528-7257f5e0102b service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.216727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c76df-e8e5-4f5d-9528-7257f5e0102b service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.217265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c76df-e8e5-4f5d-9528-7257f5e0102b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.219422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-aa9c76df-e8e5-4f5d-9528-7257f5e0102b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.223726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb799902-5219-4838-bcbe-17c468d6edcb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.238191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c76df-e8e5-4f5d-9528-7257f5e0102b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.240301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c76df-e8e5-4f5d-9528-7257f5e0102b service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:01.269711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 837/1686] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:01.285189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d5a75-2d40-4f2a-89c1-4c0efbd12556 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.287127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d5a75-2d40-4f2a-89c1-4c0efbd12556 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.287887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d5a75-2d40-4f2a-89c1-4c0efbd12556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.310436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:01.332193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5d0d5a75-2d40-4f2a-89c1-4c0efbd12556 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:01.335032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5d0d5a75-2d40-4f2a-89c1-4c0efbd12556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.344478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac0935-b0dc-488c-914e-f918bad063a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.345198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac0935-b0dc-488c-914e-f918bad063a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.345703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac0935-b0dc-488c-914e-f918bad063a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.345985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac0935-b0dc-488c-914e-f918bad063a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.348858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fbac0935-b0dc-488c-914e-f918bad063a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.470398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac0935-b0dc-488c-914e-f918bad063a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.474957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac0935-b0dc-488c-914e-f918bad063a1 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:01.487736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 838/1687] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:01.490003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7996-0758-4b13-8e79-f371ac096cc8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.490655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7996-0758-4b13-8e79-f371ac096cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.491417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7996-0758-4b13-8e79-f371ac096cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.504294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 850/1688] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:01.506021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a16505-ca6d-4a3a-9ff5-802cb3cf8158 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.506677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a16505-ca6d-4a3a-9ff5-802cb3cf8158 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.507360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a16505-ca6d-4a3a-9ff5-802cb3cf8158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.538780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a4a16505-ca6d-4a3a-9ff5-802cb3cf8158 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:01.542062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a4a16505-ca6d-4a3a-9ff5-802cb3cf8158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.545801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-64ba7996-0758-4b13-8e79-f371ac096cc8 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:01.547131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-64ba7996-0758-4b13-8e79-f371ac096cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.568451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 839/1689] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:01.572877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11789-dafc-4143-af20-76e80c53a3b6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.573017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 851/1690] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:01.573101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11789-dafc-4143-af20-76e80c53a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.573101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f11789-dafc-4143-af20-76e80c53a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.574282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a16505-ca6d-4a3a-9ff5-802cb3cf8158 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.593845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a16505-ca6d-4a3a-9ff5-802cb3cf8158 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.600395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.603492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.603907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.604854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.606017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:01.606436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.608803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:01.609721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b1f11789-dafc-4143-af20-76e80c53a3b6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:01.611742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b1f11789-dafc-4143-af20-76e80c53a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:01.632756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 840/1692] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:01.632912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 852/1692] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:01.633011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11789-dafc-4143-af20-76e80c53a3b6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.635915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.646936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f11789-dafc-4143-af20-76e80c53a3b6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.653499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.654780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.655089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.655375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.656125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:01.656437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.658635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:01.659299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39195c-6bdd-42c0-9f88-e0858ad034df admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.666967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.667781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.668812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.669198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.670159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.673493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:01.680878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 841/1693] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:01.685527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.698158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592fab-46d8-4ef7-a5be-dd030096e3bf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.704475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.710152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.710152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.710488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.711236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.713235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:01.728975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 853/1694] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:01.730297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.759035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 842/1695] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:01.765238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.849743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030070cc-4c31-4276-8ce6-8633429ab541 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.910144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:01.926300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.927003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.927490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.927771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.928594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.930730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:01.966847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc9fd8-fe0a-4823-a259-f6fd305ef8e6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:01.970200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 854/1696] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:08:01.974214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:01.983282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:01.985808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:01.986389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:01.986675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:01.988875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:01.992629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.000560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630c910-bcc4-4fc5-9bae-65975a7993a6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.012062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.012819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.013102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.013725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.016138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.021120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.041758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 843/1697] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:01 2022] POST /identity/v3/users => generated 282 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:02.044334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.053078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 855/1698] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:02.054010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.066150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23deaa-da9b-496a-b96d-cfee76284b53 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.073383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dffe32-6468-4b23-ab3a-ce67b6219053 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.079678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.079678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.079678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.079678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.080051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.081706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.092059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.093292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.093743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.094253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.095007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.096654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.100894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:02.113657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 844/1699] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:02.114688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.133724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014fc46-c0ba-47c4-b144-29a83020765b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.140331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.141043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.141392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.141726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.143105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.144924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.145381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 856/1700] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:02.149723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.164223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 845/1701] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:02.167269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.181893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16499ed8-5ac0-419e-80ea-e403a4ad1a9c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.192342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da9e85-45be-4bd0-a68b-e2a7ead5550b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.200985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57b59e-f855-435d-ad4e-36b9c5f9d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.203469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b59e-f855-435d-ad4e-36b9c5f9d601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.205481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b59e-f855-435d-ad4e-36b9c5f9d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.206773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57b59e-f855-435d-ad4e-36b9c5f9d601 admin admin] PATH_INFO: `/v3/projects/d539419a8e134302b4817401d063bab6/users/2b490beeecfb4e31bfa48747608687cc/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.207785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad738ecc-e6eb-443d-a1fa-866c28896c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.208762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738ecc-e6eb-443d-a1fa-866c28896c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.209099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738ecc-e6eb-443d-a1fa-866c28896c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.209472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad738ecc-e6eb-443d-a1fa-866c28896c34 admin admin] PATH_INFO: `/v3/projects/173ce85891394dd393943a48626eb812/users/b296b494bbdf4867bb826b7a0f6aec41/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.249105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b59e-f855-435d-ad4e-36b9c5f9d601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d539419a8e134302b4817401d063bab6, user_id=2b490beeecfb4e31bfa48747608687cc, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.252526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57b59e-f855-435d-ad4e-36b9c5f9d601 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.264949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad738ecc-e6eb-443d-a1fa-866c28896c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173ce85891394dd393943a48626eb812, user_id=b296b494bbdf4867bb826b7a0f6aec41, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.264949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad738ecc-e6eb-443d-a1fa-866c28896c34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.289865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 846/1702] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:02 2022] PUT /identity/v3/projects/173ce85891394dd393943a48626eb812/users/b296b494bbdf4867bb826b7a0f6aec41/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:02.302965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44e803-5aab-40af-a129-3717fefea41f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.303283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44e803-5aab-40af-a129-3717fefea41f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.303541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44e803-5aab-40af-a129-3717fefea41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.311834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 857/1703] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:02 2022] PUT /identity/v3/projects/d539419a8e134302b4817401d063bab6/users/2b490beeecfb4e31bfa48747608687cc/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:02.326950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938bca-36c1-416f-8ef4-c8162bd0adbf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.330056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938bca-36c1-416f-8ef4-c8162bd0adbf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.330528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c938bca-36c1-416f-8ef4-c8162bd0adbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.365631 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ca44e803-5aab-40af-a129-3717fefea41f None None] MFA Rules not processed for user `b296b494bbdf4867bb826b7a0f6aec41`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:02.366867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca44e803-5aab-40af-a129-3717fefea41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:02.389315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8c938bca-36c1-416f-8ef4-c8162bd0adbf None None] MFA Rules not processed for user `2b490beeecfb4e31bfa48747608687cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:02.390397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8c938bca-36c1-416f-8ef4-c8162bd0adbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:02.511578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 847/1704] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:02.513397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.513762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.514038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.549402 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 858/1705] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:02.549402 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c938bca-36c1-416f-8ef4-c8162bd0adbf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.572470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] MFA Rules not processed for user `887e53c1e74543ce914f94c0b2666fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:02.573973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:02.732612 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c938bca-36c1-416f-8ef4-c8162bd0adbf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.754945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.756348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.757320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.758405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.759507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.764250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.783098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 848/1706] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:02.795670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.800521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:02.820357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4ef2c-05be-4c6f-94d6-18f4e6b6b621 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.826960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:02.827941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:02.828852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:02.828852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] PATH_INFO: `/v3/projects/8945a97c092c452b91d787fef31f30d3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:02.831295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8945a97c092c452b91d787fef31f30d3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:02.836764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 859/1707] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:02 2022] POST /identity/v3/projects => generated 365 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:02.836764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:02.836998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:02.864389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:02.932559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:02.951118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8945a97c092c452b91d787fef31f30d3', 'request_id': 'req-d1584d31-1e95-4904-a3ae-cbb54a951750'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:02.978524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8945a97c092c452b91d787fef31f30d3', 'request_id': 'req-d1584d31-1e95-4904-a3ae-cbb54a951750'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:02.981976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9689f-5c98-455f-897a-c78f4a674c30 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:02.987461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8945a97c092c452b91d787fef31f30d3', 'request_id': 'req-d1584d31-1e95-4904-a3ae-cbb54a951750'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.026041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] The token cache is being invalidate because project 8945a97c092c452b91d787fef31f30d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:03.028110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.030795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.035139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 849/1708] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:02 2022] DELETE /identity/v3/projects/8945a97c092c452b91d787fef31f30d3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:03.036060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:03.038348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.088623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e894fc-b0c0-4476-b0e5-12237eeeb16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:03.089684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e894fc-b0c0-4476-b0e5-12237eeeb16b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.090823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e894fc-b0c0-4476-b0e5-12237eeeb16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.091293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e894fc-b0c0-4476-b0e5-12237eeeb16b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.092195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e894fc-b0c0-4476-b0e5-12237eeeb16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:03.094622 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e894fc-b0c0-4476-b0e5-12237eeeb16b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:03.144652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 860/1709] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:02 2022] POST /identity/v3/projects => generated 383 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:03.150697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.151358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.151978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.194378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] MFA Rules not processed for user `887e53c1e74543ce914f94c0b2666fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:03.195775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.214216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1584d31-1e95-4904-a3ae-cbb54a951750 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:03.305730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 861/1710] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:03.305730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:03.305730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.384852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:03.385831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.386351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.387192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] PATH_INFO: `/v3/projects/67082d4d077846508617d3be1f39244b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.389677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67082d4d077846508617d3be1f39244b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:03.392151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:03.448789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:03.491247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a20953-dd5e-4a7b-b45a-d867bd666872 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:03.510157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67082d4d077846508617d3be1f39244b', 'request_id': 'req-c43241f3-e455-41e6-ad50-1ce029dba6c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.520031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67082d4d077846508617d3be1f39244b', 'request_id': 'req-c43241f3-e455-41e6-ad50-1ce029dba6c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.529365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67082d4d077846508617d3be1f39244b', 'request_id': 'req-c43241f3-e455-41e6-ad50-1ce029dba6c6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.544769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] The token cache is being invalidate because project 67082d4d077846508617d3be1f39244b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:03.545067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.545844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.548248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 850/1711] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:03 2022] DELETE /identity/v3/projects/67082d4d077846508617d3be1f39244b => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:03.549166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:03.550573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.557319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:03.597150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:03.597887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.598175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.598456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.599166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:03.607030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:03.633795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43241f3-e455-41e6-ad50-1ce029dba6c6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:03.640468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 862/1712] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:03 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:03.642308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:03.643075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:03.644220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.644328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.644582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.644868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] PATH_INFO: `/v3/users/a4a656b1d4ce4a8697a3b27d6deb516e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.647164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a656b1d4ce4a8697a3b27d6deb516e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:03.651990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:03.660860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66616cd-f437-4c3a-ac93-07359b49734f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:03.668873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:03.669740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.670180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.670296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.671063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:03.673714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:03.713745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 863/1713] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:03 2022] POST /identity/v3/users => generated 298 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:03.719176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:03.723536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.739412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a656b1d4ce4a8697a3b27d6deb516e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.762177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a656b1d4ce4a8697a3b27d6deb516e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.764588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a656b1d4ce4a8697a3b27d6deb516e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.766563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a656b1d4ce4a8697a3b27d6deb516e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.779373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8c3e2f42-5540-401d-8b7d-973e8e644c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a656b1d4ce4a8697a3b27d6deb516e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:03.802808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 851/1714] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:03 2022] DELETE /identity/v3/users/a4a656b1d4ce4a8697a3b27d6deb516e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:03.806978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.807269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.807548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.836299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:03.837773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.920326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8451bfc-ab81-41cd-b2e6-a1e44c0fa4e1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:03.923735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 852/1715] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:03.924601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:03.931895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:03.949682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4767b1-29ea-4e82-8eba-6cb28415d20d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:03.955923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:03.956616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:03.956895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:03.957170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:03.957975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:03.959664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:03.981874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 853/1716] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:03.981874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:03.983647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:04.014261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610b572-7705-4972-b602-1a24df577cf4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:04.019106 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a07da-7b73-4382-be9e-e48b1db49681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:04.019781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a07da-7b73-4382-be9e-e48b1db49681 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.020057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a07da-7b73-4382-be9e-e48b1db49681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.020328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a07da-7b73-4382-be9e-e48b1db49681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.021379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a07da-7b73-4382-be9e-e48b1db49681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:04.022776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a07da-7b73-4382-be9e-e48b1db49681 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:04.034001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 854/1717] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:04.035426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6335f9-c4fa-4262-86e5-bdcbd2fa121d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.035716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6335f9-c4fa-4262-86e5-bdcbd2fa121d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.035993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6335f9-c4fa-4262-86e5-bdcbd2fa121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.049885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:04.078904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2e6335f9-c4fa-4262-86e5-bdcbd2fa121d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:04.079829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2e6335f9-c4fa-4262-86e5-bdcbd2fa121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:04.085873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:04.096712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 855/1718] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:04.097597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6335f9-c4fa-4262-86e5-bdcbd2fa121d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:04.113685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:04.114737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6335f9-c4fa-4262-86e5-bdcbd2fa121d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:04.116440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.118346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.118346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.120411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:04.139225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:04.140272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.140456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.146441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] PATH_INFO: `/v3/projects/4b1068b145cf44839655d15e81b964fd/users/0260b745b974408486c965370328aabf/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.202863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1068b145cf44839655d15e81b964fd, user_id=0260b745b974408486c965370328aabf, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:04.205648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:04.243655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 856/1719] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:04 2022] PUT /identity/v3/projects/4b1068b145cf44839655d15e81b964fd/users/0260b745b974408486c965370328aabf/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:04.244610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:04.302838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:04.306033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:04.337450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 864/1720] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:04.338374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:04.369577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e82fe2-0f4b-423b-b607-6e1be9edaff7 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:04.446780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b58d6b-b20b-4dea-8e57-3d895c15ee79 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:04.466901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edc551-558c-4970-953d-8b1e74e4fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:04.468147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edc551-558c-4970-953d-8b1e74e4fa3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.468147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edc551-558c-4970-953d-8b1e74e4fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.468380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edc551-558c-4970-953d-8b1e74e4fa3d admin admin] PATH_INFO: `/v3/projects/921fc21ef6e446efa8ab0169695e303f/users/9b4d61685b2548368da30518db4a1fd9/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.548867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edc551-558c-4970-953d-8b1e74e4fa3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=921fc21ef6e446efa8ab0169695e303f, user_id=9b4d61685b2548368da30518db4a1fd9, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:04.552301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edc551-558c-4970-953d-8b1e74e4fa3d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:04.609363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 857/1721] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:04 2022] PUT /identity/v3/projects/921fc21ef6e446efa8ab0169695e303f/users/9b4d61685b2548368da30518db4a1fd9/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:04.619852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b11b7-bb37-45fa-9e3c-27745ad49529 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.620147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b11b7-bb37-45fa-9e3c-27745ad49529 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.620515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b11b7-bb37-45fa-9e3c-27745ad49529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.649249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:04.651129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.652677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.653497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.656204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:04.658173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:04.660577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:04.694528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 865/1722] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:04.706808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:04.712583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-424b11b7-bb37-45fa-9e3c-27745ad49529 None None] MFA Rules not processed for user `ab8bc4faa499494f93571797e3c89e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:04.716615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-424b11b7-bb37-45fa-9e3c-27745ad49529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:04.733085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e5b15-d70a-4d31-9429-50171192fac0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:04.873470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:04.874269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.874413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.874650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.875424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:04.877107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:04.908850 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 866/1723] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:04.909817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:04.920418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:04.943024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3ac9c-40cf-482e-87e2-1cb4b4b3678c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:04.955372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 858/1724] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:04.958630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b11b7-bb37-45fa-9e3c-27745ad49529 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:04.974245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:04.975234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:04.975234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:04.975428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] PATH_INFO: `/v3/projects/5d3384da5cb041a0ae1681630da7bfbc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:04.979821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3384da5cb041a0ae1681630da7bfbc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:04.982098 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:04.990753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b11b7-bb37-45fa-9e3c-27745ad49529 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:05.004813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:05.005555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.005836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.010962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.012372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:05.020713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:05.052292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 859/1725] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:05.053232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:05.069244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:05.083176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed5af-55d6-41ed-9372-108a092644d1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:05.098157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3384da5cb041a0ae1681630da7bfbc', 'request_id': 'req-596e7c05-f12b-4524-b661-dfc3c5946bea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:05.113467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3384da5cb041a0ae1681630da7bfbc', 'request_id': 'req-596e7c05-f12b-4524-b661-dfc3c5946bea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:05.127487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3384da5cb041a0ae1681630da7bfbc', 'request_id': 'req-596e7c05-f12b-4524-b661-dfc3c5946bea'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:05.171930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] The token cache is being invalidate because project 5d3384da5cb041a0ae1681630da7bfbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:05.172284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:05.172938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:05.174643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 867/1726] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:04 2022] DELETE /identity/v3/projects/5d3384da5cb041a0ae1681630da7bfbc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:05.175972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:05.178224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:05.182500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:05.248868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:05.253429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.253792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.254067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.254813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:05.261375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:05.322835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 860/1727] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:05 2022] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:05.323917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:05.344599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:05.349949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e7c05-f12b-4524-b661-dfc3c5946bea admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:05.454951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:05.456746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.458926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.459344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] PATH_INFO: `/v3/projects/4b1068b145cf44839655d15e81b964fd/users/0260b745b974408486c965370328aabf/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.465051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1068b145cf44839655d15e81b964fd, user_id=0260b745b974408486c965370328aabf, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:05.468403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:05.497385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 868/1728] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:05 2022] PUT /identity/v3/projects/4b1068b145cf44839655d15e81b964fd/users/0260b745b974408486c965370328aabf/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:05.507385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:05.509236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:05.566706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf521217-070d-4249-9e25-4684cb5fa827 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:05.639860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:05.656599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941750e-e2b8-42c4-ae73-527cdcfb5e86 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:05.663643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad448c-b731-4598-bc52-9f4c0a24713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:05.664892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad448c-b731-4598-bc52-9f4c0a24713c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.665179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad448c-b731-4598-bc52-9f4c0a24713c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.665589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad448c-b731-4598-bc52-9f4c0a24713c admin admin] PATH_INFO: `/v3/projects/921fc21ef6e446efa8ab0169695e303f/users/9b4d61685b2548368da30518db4a1fd9/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.668706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad448c-b731-4598-bc52-9f4c0a24713c admin admin] RBAC: Authorizing `identity:create_grant(project_id=921fc21ef6e446efa8ab0169695e303f, user_id=9b4d61685b2548368da30518db4a1fd9, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:05.674093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad448c-b731-4598-bc52-9f4c0a24713c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:05.711354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 869/1729] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:05 2022] PUT /identity/v3/projects/921fc21ef6e446efa8ab0169695e303f/users/9b4d61685b2548368da30518db4a1fd9/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:05.711354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.711354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.711354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.754522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:05.756642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:05.774298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f94f-2a5f-4258-8de7-0c47a47d365f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:05.776146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f94f-2a5f-4258-8de7-0c47a47d365f service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.776432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f94f-2a5f-4258-8de7-0c47a47d365f service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.778005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f94f-2a5f-4258-8de7-0c47a47d365f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.785690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-98f4f94f-2a5f-4258-8de7-0c47a47d365f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:05.895827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 870/1730] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:05.895827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:05.897031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:05.912682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c586c4-6507-49d5-a9df-85e3246ec453 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:05.918582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84d41d-f5f5-4a80-9140-a260ceafce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:05.919894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d41d-f5f5-4a80-9140-a260ceafce7c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.920574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d41d-f5f5-4a80-9140-a260ceafce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.921088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84d41d-f5f5-4a80-9140-a260ceafce7c admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.921975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d41d-f5f5-4a80-9140-a260ceafce7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:05.924396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84d41d-f5f5-4a80-9140-a260ceafce7c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:05.943501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:05.951309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4f94f-2a5f-4258-8de7-0c47a47d365f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:05.954292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4f94f-2a5f-4258-8de7-0c47a47d365f service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:05.955387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 871/1731] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:05 2022] POST /identity/v3/users => generated 282 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:05.957015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205fa5-8398-487b-b27e-02d9292ffc49 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.957442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205fa5-8398-487b-b27e-02d9292ffc49 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.957944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8205fa5-8398-487b-b27e-02d9292ffc49 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.959574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 872/1732] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 14:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:08:05.961081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f801-1aef-4dff-8bc9-f4c227da6b47 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.961620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f801-1aef-4dff-8bc9-f4c227da6b47 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.962095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f801-1aef-4dff-8bc9-f4c227da6b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.972235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 861/1733] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:05.974349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3abd6-3864-4b3d-8317-59daaa787089 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:05.974777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3abd6-3864-4b3d-8317-59daaa787089 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:05.975212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3abd6-3864-4b3d-8317-59daaa787089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:05.996843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fe72f801-1aef-4dff-8bc9-f4c227da6b47 None None] MFA Rules not processed for user `0260b745b974408486c965370328aabf`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:05.998712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fe72f801-1aef-4dff-8bc9-f4c227da6b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.024028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-39a3abd6-3864-4b3d-8317-59daaa787089 None None] MFA Rules not processed for user `9b4d61685b2548368da30518db4a1fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:06.026454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-39a3abd6-3864-4b3d-8317-59daaa787089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.224192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 873/1734] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:06.225805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f8cd-e1de-47a7-9661-cddb4aa0f1ad None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.226125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f8cd-e1de-47a7-9661-cddb4aa0f1ad None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.226730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f8cd-e1de-47a7-9661-cddb4aa0f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.281423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 862/1735] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:06.282832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3abd6-3864-4b3d-8317-59daaa787089 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.291443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a703f8cd-e1de-47a7-9661-cddb4aa0f1ad None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:06.292683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a703f8cd-e1de-47a7-9661-cddb4aa0f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.323669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 874/1736] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:06.324560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3abd6-3864-4b3d-8317-59daaa787089 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:06.329918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.330208 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.333283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.339568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3afcb-83f7-4ce7-a400-e2d257972e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:06.342175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3afcb-83f7-4ce7-a400-e2d257972e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.344134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3afcb-83f7-4ce7-a400-e2d257972e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.344447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3afcb-83f7-4ce7-a400-e2d257972e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.347132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3afcb-83f7-4ce7-a400-e2d257972e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:06.351047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3afcb-83f7-4ce7-a400-e2d257972e24 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:06.387500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 863/1737] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:06.390737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d91fa-9ea4-4c96-a8b3-7a319e699f10 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.391050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d91fa-9ea4-4c96-a8b3-7a319e699f10 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.396889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d91fa-9ea4-4c96-a8b3-7a319e699f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.443315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] MFA Rules not processed for user `2b28926500a14cd3aa74c59f60e076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:06.444555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.486785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-483d91fa-9ea4-4c96-a8b3-7a319e699f10 None None] MFA Rules not processed for user `371340721cfc4b778ec39ccc167172e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:06.488020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-483d91fa-9ea4-4c96-a8b3-7a319e699f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.544411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:06.585284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 875/1738] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:06.597454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.602115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.649780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 864/1739] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:06.650933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d91fa-9ea4-4c96-a8b3-7a319e699f10 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.666186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d91fa-9ea4-4c96-a8b3-7a319e699f10 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:06.671648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:06.672542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.672917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.673984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.674244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:06.674394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:06.677097 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:06.694165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 865/1740] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:06.695170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.707712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456dba2-af77-454a-9370-78585ab4b2b8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:06.716046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:06.717425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.717925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.718503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.719424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:06.721551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:06.738705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4b4a5-cf39-4835-ad3b-b1a5c6ba125d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:06.742489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 866/1741] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:06.743506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.747439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.754188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:06.754858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.755142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.755426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.766461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74d6dd-a932-41a8-bb36-301a8dc252dd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:06.775000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:06.776507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:06.779132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:06.779873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.780507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.780507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.786413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.805518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 876/1742] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:06.806471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.813039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.838292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a119d90-013c-48b9-979a-742e194b5398 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:06.848788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd6b1f-61fa-4216-ad1d-e823a76510d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:06.849613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6b1f-61fa-4216-ad1d-e823a76510d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.850443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6b1f-61fa-4216-ad1d-e823a76510d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.850443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd6b1f-61fa-4216-ad1d-e823a76510d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.857229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:06.879022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd6b1f-61fa-4216-ad1d-e823a76510d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:06.880888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd6b1f-61fa-4216-ad1d-e823a76510d7 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:06.902970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 877/1743] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:06.904306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d6730-59e2-45c3-9921-7270f6a6b299 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:06.904598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d6730-59e2-45c3-9921-7270f6a6b299 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:06.908343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d6730-59e2-45c3-9921-7270f6a6b299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:06.912430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:06.914232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:06.946968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4f2d6730-59e2-45c3-9921-7270f6a6b299 None None] MFA Rules not processed for user `371340721cfc4b778ec39ccc167172e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:06.948458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4f2d6730-59e2-45c3-9921-7270f6a6b299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:06.950981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 867/1744] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:06.953119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.968573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 878/1745] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:06.969431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d6730-59e2-45c3-9921-7270f6a6b299 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:06.990812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8c274-7bea-4ed9-bcc8-8e91ee2aef14 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:06.994685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d6730-59e2-45c3-9921-7270f6a6b299 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:07.005955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.006643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.006899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.007055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.007182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.007953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.008063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:07.008239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.008514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] PATH_INFO: `/v3/projects/277297353ba94ba4b6e3b2fbc25954cf/users/cb0842400bed4f6683be8753eb76bd3c/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.010011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:07.050409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=277297353ba94ba4b6e3b2fbc25954cf, user_id=cb0842400bed4f6683be8753eb76bd3c, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:07.057632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:07.093988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 868/1746] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:06 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:07.096461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:07.107987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 879/1747] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:06 2022] PUT /identity/v3/projects/277297353ba94ba4b6e3b2fbc25954cf/users/cb0842400bed4f6683be8753eb76bd3c/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:07.108651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:07.320860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb12e9-a692-456a-af14-17134603e5e4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:07.348187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67a1c9-14d7-4303-855f-189cebdaa13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.351394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67a1c9-14d7-4303-855f-189cebdaa13f service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.351681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67a1c9-14d7-4303-855f-189cebdaa13f service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.351960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67a1c9-14d7-4303-855f-189cebdaa13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.420100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3bd7-e878-4ece-b242-f1f2608e6f5f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:07.470279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67a1c9-14d7-4303-855f-189cebdaa13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:07.478037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67a1c9-14d7-4303-855f-189cebdaa13f service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:07.509300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 869/1748] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:07.516612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104a7d0-1519-48c2-ac13-aee27d6f23f1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.519865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104a7d0-1519-48c2-ac13-aee27d6f23f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.520384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104a7d0-1519-48c2-ac13-aee27d6f23f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.581642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:07.605530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7104a7d0-1519-48c2-ac13-aee27d6f23f1 None None] MFA Rules not processed for user `cb0842400bed4f6683be8753eb76bd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:07.607454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.608188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.608426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.608700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.609598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:07.610485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7104a7d0-1519-48c2-ac13-aee27d6f23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:07.611448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:07.653167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 880/1749] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:07 2022] POST /identity/v3/users => generated 291 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:07.659760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:07.693217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ae8cc-a427-4598-983e-7799b865da4e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:07.699913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:07.712530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.713156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.713468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.713735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.714599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:07.716271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:07.753539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 881/1750] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:07.757453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:07.781476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55296abf-4ba9-4168-8c4a-a8877f3b6fb7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:07.799642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.800569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.801023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.802106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.802986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:07.812727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:07.813203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 870/1751] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:07.817046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104a7d0-1519-48c2-ac13-aee27d6f23f1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:07.868357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104a7d0-1519-48c2-ac13-aee27d6f23f1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:07.873936 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 882/1752] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:07.875804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:07.901545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.902439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.903474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.907135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:07.913292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734609b-13e1-44e3-977f-a3c7cbdf84f1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:07.913817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:07.916765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:07.967724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:07.972780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:07.973107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:07.973513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] PATH_INFO: `/v3/projects/2b7acfc87add4980825bfe4ddc32d8e0/users/cdb93ea699b44eb7bb6306e3e81992d2/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.031596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7acfc87add4980825bfe4ddc32d8e0, user_id=cdb93ea699b44eb7bb6306e3e81992d2, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:08.035068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 871/1753] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:07 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:08.036420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:08.037571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:08.088586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 883/1754] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:07 2022] PUT /identity/v3/projects/2b7acfc87add4980825bfe4ddc32d8e0/users/cdb93ea699b44eb7bb6306e3e81992d2/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:08.093499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:08.100340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:08.234142 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b911946-0c96-467a-ab5a-4b843acf5085 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:08.407389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51d16b-a504-4c34-add8-60a6c49826b3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:08.422347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd14a1-e49a-4ff3-8612-4302c7fcd0c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:08.424786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd14a1-e49a-4ff3-8612-4302c7fcd0c2 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.425076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd14a1-e49a-4ff3-8612-4302c7fcd0c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.425385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd14a1-e49a-4ff3-8612-4302c7fcd0c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.425816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84674-67ef-43e3-91a2-7e2909350bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:08.431148 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84674-67ef-43e3-91a2-7e2909350bcb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.437144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ffd14a1-e49a-4ff3-8612-4302c7fcd0c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:08.438882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84674-67ef-43e3-91a2-7e2909350bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.439224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84674-67ef-43e3-91a2-7e2909350bcb admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.440942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84674-67ef-43e3-91a2-7e2909350bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:08.452315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd14a1-e49a-4ff3-8612-4302c7fcd0c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:08.453235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84674-67ef-43e3-91a2-7e2909350bcb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:08.455315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd14a1-e49a-4ff3-8612-4302c7fcd0c2 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:08.469514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 884/1755] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:08.471075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23668-536f-4fdc-977a-2cc9a5a57efb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.471378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23668-536f-4fdc-977a-2cc9a5a57efb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.471644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d23668-536f-4fdc-977a-2cc9a5a57efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.545299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 872/1756] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:08 2022] POST /identity/v3/users => generated 287 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:08.545797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7ca0-9b3c-4ff1-b5ab-b6899abde0a1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.546164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7ca0-9b3c-4ff1-b5ab-b6899abde0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.546514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7ca0-9b3c-4ff1-b5ab-b6899abde0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.584523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-62d23668-536f-4fdc-977a-2cc9a5a57efb None None] MFA Rules not processed for user `cdb93ea699b44eb7bb6306e3e81992d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:08.591354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-62d23668-536f-4fdc-977a-2cc9a5a57efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:08.654514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-72eb7ca0-9b3c-4ff1-b5ab-b6899abde0a1 None None] MFA Rules not processed for user `887e53c1e74543ce914f94c0b2666fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:08.657299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-72eb7ca0-9b3c-4ff1-b5ab-b6899abde0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:08.774422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 885/1757] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:08.776546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23668-536f-4fdc-977a-2cc9a5a57efb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:08.789664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:08.805040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d23668-536f-4fdc-977a-2cc9a5a57efb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:08.808973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 873/1758] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:08.810521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c2b2-b73e-4079-b21a-aad7e2154669 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.810916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c2b2-b73e-4079-b21a-aad7e2154669 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.812136 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c2b2-b73e-4079-b21a-aad7e2154669 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.815686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 874/1759] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 14:08:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:08:08.816927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:08.818527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.818821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.819199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.819831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:08.821903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:08.822380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064c2b2-b73e-4079-b21a-aad7e2154669 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:08.837773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 886/1760] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:08.839526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:08.854444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064c2b2-b73e-4079-b21a-aad7e2154669 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:08.855638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1526f3-48a2-40d6-8dea-055807a34cdb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:08.865799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622afbd-ba5f-4144-a28c-5ffbb09e1460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:08.868949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622afbd-ba5f-4144-a28c-5ffbb09e1460 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.869370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622afbd-ba5f-4144-a28c-5ffbb09e1460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.869844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622afbd-ba5f-4144-a28c-5ffbb09e1460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.872279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622afbd-ba5f-4144-a28c-5ffbb09e1460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:08.878178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:08.879100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.879381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622afbd-ba5f-4144-a28c-5ffbb09e1460 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:08.879490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.879680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] PATH_INFO: `/v3/users/b296b494bbdf4867bb826b7a0f6aec41` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.886553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b296b494bbdf4867bb826b7a0f6aec41)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:08.891600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:08.901684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:08.947568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 875/1761] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:08 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:08.949054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:08.951660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:08.951988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:08.987374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] MFA Rules not processed for user `2b28926500a14cd3aa74c59f60e076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:08.989499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:08.992217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b296b494bbdf4867bb826b7a0f6aec41'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:09.007394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b296b494bbdf4867bb826b7a0f6aec41'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:09.008398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b296b494bbdf4867bb826b7a0f6aec41'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:09.036762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b296b494bbdf4867bb826b7a0f6aec41'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:09.040710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b296b494bbdf4867bb826b7a0f6aec41'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:09.074484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 887/1762] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:08 2022] DELETE /identity/v3/users/b296b494bbdf4867bb826b7a0f6aec41 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:09.075617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.077397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:09.093101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 876/1763] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:08:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:09.094270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.096640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:09.247492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2977a9-184d-496a-9580-868cc95c3f45 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.258285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b581075-4866-432e-8f2e-db4857a85750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.260698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581075-4866-432e-8f2e-db4857a85750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.262076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581075-4866-432e-8f2e-db4857a85750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.264061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b581075-4866-432e-8f2e-db4857a85750 admin admin] PATH_INFO: `/v3/projects/d37460b1d9be44398e4373ef2a85e311/users/9cc66379d20b4e348ad3714e90dd78a0/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.273088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139039e-aaad-46a4-995a-591b8ead3cca None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.297972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581075-4866-432e-8f2e-db4857a85750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37460b1d9be44398e4373ef2a85e311, user_id=9cc66379d20b4e348ad3714e90dd78a0, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:09.300598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.301303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.301623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.301906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.302619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:09.303154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b581075-4866-432e-8f2e-db4857a85750 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:09.304561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:09.341696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 888/1764] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:09 2022] PUT /identity/v3/projects/d37460b1d9be44398e4373ef2a85e311/users/9cc66379d20b4e348ad3714e90dd78a0/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:09.343666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73452c53-1e1f-4fd0-b09b-110af52f5d36 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.343964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73452c53-1e1f-4fd0-b09b-110af52f5d36 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.344313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73452c53-1e1f-4fd0-b09b-110af52f5d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.373425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-73452c53-1e1f-4fd0-b09b-110af52f5d36 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:09.375458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-73452c53-1e1f-4fd0-b09b-110af52f5d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:09.379713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 877/1765] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:09 2022] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:09.388663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.394147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:09.467856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 889/1766] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:09.468974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73452c53-1e1f-4fd0-b09b-110af52f5d36 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.475457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:09.483989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73452c53-1e1f-4fd0-b09b-110af52f5d36 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.492154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.492892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.493185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.494006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.494909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:09.507021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:09.538389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 890/1767] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:09.539004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.590343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9d5ec-b02f-4762-a4ac-a419a17c7da1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.597306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.598051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.598336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.598653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.599379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:09.604572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:09.615421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2dae5-4b73-46c6-af6e-6a7b5a8d8be3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.626321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 891/1768] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:09.627404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.633039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:09.693715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:09.751820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.752802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.752989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.753406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.773771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:09.776018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:09.778603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97566bd-6da8-4805-87d5-29a372302cb7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.788301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.789149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.789411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.789695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.802595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 878/1769] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:09.803836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.816371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:09.818409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4db1ca-baa4-4a6e-89ce-01f0456f5a5e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.818841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:09.825950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334559b-8d55-4438-9bf7-876234f40902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.827277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334559b-8d55-4438-9bf7-876234f40902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.827836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334559b-8d55-4438-9bf7-876234f40902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.828719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334559b-8d55-4438-9bf7-876234f40902 admin admin] PATH_INFO: `/v3/projects/d37460b1d9be44398e4373ef2a85e311/users/9cc66379d20b4e348ad3714e90dd78a0/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.831521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334559b-8d55-4438-9bf7-876234f40902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37460b1d9be44398e4373ef2a85e311, user_id=9cc66379d20b4e348ad3714e90dd78a0, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:09.834995 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334559b-8d55-4438-9bf7-876234f40902 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:09.848334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 892/1770] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:09.849888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:09.853679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 879/1771] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:09 2022] PUT /identity/v3/projects/d37460b1d9be44398e4373ef2a85e311/users/9cc66379d20b4e348ad3714e90dd78a0/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:09.868809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.871611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.872280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:09.875813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4c1ce-0eeb-43db-8d9f-fb387f710482 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:09.924119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] MFA Rules not processed for user `9cc66379d20b4e348ad3714e90dd78a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:09.925829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:09.986154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:09.987246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:09.987591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:09.987872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] PATH_INFO: `/v3/projects/6e9400fa9c064c7daac958775a38cae8/users/da5d8b0248264444b499c0d7181056fb/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:10.025878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9400fa9c064c7daac958775a38cae8, user_id=da5d8b0248264444b499c0d7181056fb, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:10.029255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:10.042213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 880/1772] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:09 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:10.057582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:10.060603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:10.085328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 893/1773] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:09 2022] PUT /identity/v3/projects/6e9400fa9c064c7daac958775a38cae8/users/da5d8b0248264444b499c0d7181056fb/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:10.094480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:10.205597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a500b-a66e-4541-9f6d-52cd663c6352 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:10.292310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282ba49-761e-4184-ab86-58eb881e07f1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:10.300224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:10.301190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:10.301824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:10.302406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:10.303383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:10.305529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:10.321390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 894/1774] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:10.325587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:10.335994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:10.367802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37ab53-e5b2-49a9-84be-31a0556db5a9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:10.382236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a06af-7bd2-4b2f-90ac-1e9b864faecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:10.384062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a06af-7bd2-4b2f-90ac-1e9b864faecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:10.388330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a06af-7bd2-4b2f-90ac-1e9b864faecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:10.393686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a06af-7bd2-4b2f-90ac-1e9b864faecf admin admin] PATH_INFO: `/v3/projects/6e9400fa9c064c7daac958775a38cae8/users/da5d8b0248264444b499c0d7181056fb/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:10.396922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a06af-7bd2-4b2f-90ac-1e9b864faecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9400fa9c064c7daac958775a38cae8, user_id=da5d8b0248264444b499c0d7181056fb, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:10.403954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dd02a-e5c2-4582-a1db-99057a220259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:10.406656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a06af-7bd2-4b2f-90ac-1e9b864faecf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:10.418940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dd02a-e5c2-4582-a1db-99057a220259 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:10.419247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dd02a-e5c2-4582-a1db-99057a220259 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:10.419533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dd02a-e5c2-4582-a1db-99057a220259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:10.443390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 895/1775] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:10 2022] PUT /identity/v3/projects/6e9400fa9c064c7daac958775a38cae8/users/da5d8b0248264444b499c0d7181056fb/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:10.456023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4dbb-4a14-4008-a049-d741f3dbefc8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:10.456330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4dbb-4a14-4008-a049-d741f3dbefc8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:10.456582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4dbb-4a14-4008-a049-d741f3dbefc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:10.464370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:10.585093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b51e4dbb-4a14-4008-a049-d741f3dbefc8 None None] MFA Rules not processed for user `da5d8b0248264444b499c0d7181056fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:10.587645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b51e4dbb-4a14-4008-a049-d741f3dbefc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:10.614240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dd02a-e5c2-4582-a1db-99057a220259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:10.615984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dd02a-e5c2-4582-a1db-99057a220259 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:10.648683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 881/1776] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:10 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:10.800569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 896/1777] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:10.929085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:10.929442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:10.929734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:10.993037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] MFA Rules not processed for user `ab8bc4faa499494f93571797e3c89e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:10.994528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:10.998680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4dbb-4a14-4008-a049-d741f3dbefc8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:11.148790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 882/1778] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:11.216778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e4dbb-4a14-4008-a049-d741f3dbefc8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:11.230969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:11.232482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:11.232771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:11.233048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:11.272937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:11.281381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:11.327047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 897/1779] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:11.519570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:11.522410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:11.556267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f5b2-9be0-41a6-874b-a813d1d58bdc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:11.564405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:11.565038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:11.565320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:11.565616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:11.578312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:11.798882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:11.800978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:11.835669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 883/1780] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:12.350976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:12.366083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f9cdb-417c-4c56-9263-853f37f9f857 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:12.381439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4701d-1da0-4c9d-983d-b8099c4dfce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:12.381702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4701d-1da0-4c9d-983d-b8099c4dfce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:12.381897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4701d-1da0-4c9d-983d-b8099c4dfce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:12.383336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4701d-1da0-4c9d-983d-b8099c4dfce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:12.389827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d8a4701d-1da0-4c9d-983d-b8099c4dfce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:12.411828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:12.413679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:12.643088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:12.646537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4701d-1da0-4c9d-983d-b8099c4dfce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:12.656009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4701d-1da0-4c9d-983d-b8099c4dfce7 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:12.698196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff63dc9-5d93-4efa-8834-b4351e0d5eef service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:12.703132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 898/1781] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:12.706732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:12.707258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:12.708402 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:12.716429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:12.720375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:12.721479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:12.722274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] PATH_INFO: `/v3/projects/173ce85891394dd393943a48626eb812` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:12.725384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173ce85891394dd393943a48626eb812)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:12.728541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:12.789330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:12.846262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:12.847599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:12.855694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173ce85891394dd393943a48626eb812', 'request_id': 'req-01702fe1-91eb-4f32-901b-2f5f534d5231'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:12.875712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173ce85891394dd393943a48626eb812', 'request_id': 'req-01702fe1-91eb-4f32-901b-2f5f534d5231'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:12.884800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173ce85891394dd393943a48626eb812', 'request_id': 'req-01702fe1-91eb-4f32-901b-2f5f534d5231'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:12.905774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] The token cache is being invalidate because project 173ce85891394dd393943a48626eb812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:12.906174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:12.906899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:12.909390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 884/1782] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:12 2022] DELETE /identity/v3/projects/173ce85891394dd393943a48626eb812 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:12.912766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:12.914854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:13.003389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 899/1783] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:08:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:13.040635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01702fe1-91eb-4f32-901b-2f5f534d5231 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:13.063284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:13.064128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:13.064413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:13.064690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] PATH_INFO: `/v3/users/0260b745b974408486c965370328aabf` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:13.066187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0260b745b974408486c965370328aabf)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:13.068747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:13.172449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0260b745b974408486c965370328aabf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:13.194259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0260b745b974408486c965370328aabf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:13.196722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0260b745b974408486c965370328aabf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:13.197694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0260b745b974408486c965370328aabf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:13.208202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0260b745b974408486c965370328aabf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:13.240734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 885/1784] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:12 2022] DELETE /identity/v3/users/0260b745b974408486c965370328aabf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:13.254028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:13.256152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:13.502425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c60a2a-b893-40b8-9a59-b23ed1c7a950 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:13.668246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf089d-6dfd-4fe2-84ff-30fb633792c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:13.668995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf089d-6dfd-4fe2-84ff-30fb633792c2 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:13.669338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf089d-6dfd-4fe2-84ff-30fb633792c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:13.669814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf089d-6dfd-4fe2-84ff-30fb633792c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:13.676261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-83bf089d-6dfd-4fe2-84ff-30fb633792c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:13.710282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:13.853331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf089d-6dfd-4fe2-84ff-30fb633792c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:13.855873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf089d-6dfd-4fe2-84ff-30fb633792c2 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:13.887336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 900/1785] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:08:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:08:15.421567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:15.423407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:15.432025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:15.709425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1598f72-e178-4906-a467-ecfc4ae76f49 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:15.734423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:15.753935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:15.753935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:15.753935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] PATH_INFO: `/v3/projects/4b1068b145cf44839655d15e81b964fd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:15.753935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1068b145cf44839655d15e81b964fd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:15.771268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:15.899977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1068b145cf44839655d15e81b964fd', 'request_id': 'req-0561abc1-165a-453f-9fe1-9a29d79b286e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:15.921584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1068b145cf44839655d15e81b964fd', 'request_id': 'req-0561abc1-165a-453f-9fe1-9a29d79b286e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:15.927980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1068b145cf44839655d15e81b964fd', 'request_id': 'req-0561abc1-165a-453f-9fe1-9a29d79b286e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:15.956368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] The token cache is being invalidate because project 4b1068b145cf44839655d15e81b964fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:15.957437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:15.957826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0561abc1-165a-453f-9fe1-9a29d79b286e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:15.963139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 886/1786] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:15 2022] DELETE /identity/v3/projects/4b1068b145cf44839655d15e81b964fd => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:15.968543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7178fc-0c6e-4c04-8f4d-459b3229dbd4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:15.969506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7178fc-0c6e-4c04-8f4d-459b3229dbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:15.969954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7178fc-0c6e-4c04-8f4d-459b3229dbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:16.007166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ef7178fc-0c6e-4c04-8f4d-459b3229dbd4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:16.021183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ef7178fc-0c6e-4c04-8f4d-459b3229dbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:16.195549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 901/1787] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:16.196569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c08d7-b590-4594-9009-8889cfa8e366 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:16.196931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c08d7-b590-4594-9009-8889cfa8e366 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:16.197222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c08d7-b590-4594-9009-8889cfa8e366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:16.254457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b02c08d7-b590-4594-9009-8889cfa8e366 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:16.258383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b02c08d7-b590-4594-9009-8889cfa8e366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:16.282639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 887/1788] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:16.286825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7178fc-0c6e-4c04-8f4d-459b3229dbd4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:16.298127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7178fc-0c6e-4c04-8f4d-459b3229dbd4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:16.312676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:16.313306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:16.313586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:16.313864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:16.314610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:16.314904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:16.316545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:16.361804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 902/1789] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:16.366330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c08d7-b590-4594-9009-8889cfa8e366 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:16.383204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c08d7-b590-4594-9009-8889cfa8e366 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:16.390804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b188a37-7ccf-4569-9767-a4954f3b4117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:16.391918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188a37-7ccf-4569-9767-a4954f3b4117 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:16.392419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188a37-7ccf-4569-9767-a4954f3b4117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:16.392955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188a37-7ccf-4569-9767-a4954f3b4117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:16.393948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b188a37-7ccf-4569-9767-a4954f3b4117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:16.396490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b188a37-7ccf-4569-9767-a4954f3b4117 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:16.478283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 888/1790] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:16 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:16.484750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:16.498029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5897-037c-476e-b978-2145de258c33 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:16.748318 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:16.749030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:16.749313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:16.749637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:16.768546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:16.771103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:16.861948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02e9b-ce52-4dc1-a8d6-2b7d2f0ee93d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:16.862612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02e9b-ce52-4dc1-a8d6-2b7d2f0ee93d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:16.863050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02e9b-ce52-4dc1-a8d6-2b7d2f0ee93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:16.866261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 903/1791] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:16 2022] POST /identity/v3/users => generated 285 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:16.872185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:16.896566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6dd98-f915-45f4-be80-327f71529937 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:16.906171 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:16.907043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:16.907345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:16.907625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:16.908368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:16.910862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:16.931158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 904/1792] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:16.932375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:16.935862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:16.968030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-76f02e9b-ce52-4dc1-a8d6-2b7d2f0ee93d None None] MFA Rules not processed for user `2b28926500a14cd3aa74c59f60e076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:16.985222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-76f02e9b-ce52-4dc1-a8d6-2b7d2f0ee93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:16.985333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29836172-7925-4d19-9e82-dec3987bc2ac admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:17.003545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:17.004451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:17.004967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:17.005543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] PATH_INFO: `/v3/users/cb0842400bed4f6683be8753eb76bd3c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:17.006982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0842400bed4f6683be8753eb76bd3c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:17.009630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:17.039845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:17.188038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0842400bed4f6683be8753eb76bd3c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:17.219397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 889/1793] 10.222.0.74 () {58 vars in 1015 bytes} [Mon Jul 18 14:08:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:17.220592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0842400bed4f6683be8753eb76bd3c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:17.221312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0842400bed4f6683be8753eb76bd3c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:17.223289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f02e9b-ce52-4dc1-a8d6-2b7d2f0ee93d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:17.259270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0842400bed4f6683be8753eb76bd3c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:17.265842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e5d08df2-ae1d-4fd4-98d4-b140776e21d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0842400bed4f6683be8753eb76bd3c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:17.275412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f02e9b-ce52-4dc1-a8d6-2b7d2f0ee93d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:17.303099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:17.303809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:17.304208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:17.304368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:17.308460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:17.308657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 905/1794] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:16 2022] DELETE /identity/v3/users/cb0842400bed4f6683be8753eb76bd3c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:17.310028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:17.310571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:17.310962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:17.312048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:17.363038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 890/1795] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:17.365092 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:17.366529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:17.373415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:17.377741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:17.388308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:17.418766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bf86e-c41c-4bf2-8da9-fc3ef0712952 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:17.553528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 906/1796] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:17.553528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:17.553528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:17.590290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:17.600372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:17.600647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:17.600932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] PATH_INFO: `/v3/projects/94c6c8a9c45440f8a86f3850a5cc7985/users/a35b6651f5c6413389c5cb07aece4bc2/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:17.651461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94c6c8a9c45440f8a86f3850a5cc7985, user_id=a35b6651f5c6413389c5cb07aece4bc2, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:17.662163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:17.705055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e032f3b-dac1-48a4-96dd-38055c9852b7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:17.708666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 891/1797] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:17 2022] PUT /identity/v3/projects/94c6c8a9c45440f8a86f3850a5cc7985/users/a35b6651f5c6413389c5cb07aece4bc2/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:17.710209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:17.716881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:17.801817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:17.817852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:17.819669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:17.819964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:17.820242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:17.824767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:17.847757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30834325-c13d-412f-81b9-4a35b1f11a16 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:17.851726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93352d-7c6f-428a-94f9-45ac6e0b98b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:17.852394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93352d-7c6f-428a-94f9-45ac6e0b98b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:17.852676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93352d-7c6f-428a-94f9-45ac6e0b98b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:17.852957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93352d-7c6f-428a-94f9-45ac6e0b98b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:17.952594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:17.954930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:17.955501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93352d-7c6f-428a-94f9-45ac6e0b98b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:17.957100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93352d-7c6f-428a-94f9-45ac6e0b98b4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:17.971670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 892/1798] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:17.973334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc343762-c2f9-40fa-bf03-9a24e0fac291 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:17.982532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc343762-c2f9-40fa-bf03-9a24e0fac291 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:17.983038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc343762-c2f9-40fa-bf03-9a24e0fac291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:17.987721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 907/1799] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:18.092366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-dc343762-c2f9-40fa-bf03-9a24e0fac291 None None] MFA Rules not processed for user `a35b6651f5c6413389c5cb07aece4bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:18.094095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dc343762-c2f9-40fa-bf03-9a24e0fac291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:18.170862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:18.355646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 893/1800] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:18.360459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:18.379533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c94ef3-ca03-41db-948e-87938e6e122b service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:18.415035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:18.415799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:18.416085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:18.416568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:18.418225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:18.420561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:18.460113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 908/1801] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:18 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:18.465675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc343762-c2f9-40fa-bf03-9a24e0fac291 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:18.485017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc343762-c2f9-40fa-bf03-9a24e0fac291 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:18.647548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:18.648243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:18.648528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:18.648860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:18.650339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:18.654151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:18.703374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 894/1802] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:18 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:18.707056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:18.728559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe98b6c-1ba8-4daf-a8e2-7d049fbffbfd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:18.748830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:18.752503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:18.752884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:18.753203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:18.754083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:18.756503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:18.810778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:18.815204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:18.819723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 909/1803] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:18.820717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:18.857275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ae3af-c471-436c-bcac-1cba37efad43 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:18.874937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:18.875909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:18.876342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:18.876709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] PATH_INFO: `/v3/projects/56c5c7b47d5440e8bd07c73236bc605e/users/e05b2ba366b94dd6bea76f21e34ca900/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:18.878877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261569-45fb-49ce-9194-cfc0fc1b0618 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:18.887782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:18.905914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:18.907208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:18.909945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] PATH_INFO: `/v3/projects/277297353ba94ba4b6e3b2fbc25954cf` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:18.911724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277297353ba94ba4b6e3b2fbc25954cf)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:18.924629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:18.929455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c5c7b47d5440e8bd07c73236bc605e, user_id=e05b2ba366b94dd6bea76f21e34ca900, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:18.932401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:18.979124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 910/1804] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:18 2022] PUT /identity/v3/projects/56c5c7b47d5440e8bd07c73236bc605e/users/e05b2ba366b94dd6bea76f21e34ca900/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:18.984656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:19.045839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277297353ba94ba4b6e3b2fbc25954cf', 'request_id': 'req-26740dea-699d-4bc6-bbc6-d12c70621152'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.059158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277297353ba94ba4b6e3b2fbc25954cf', 'request_id': 'req-26740dea-699d-4bc6-bbc6-d12c70621152'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.085378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277297353ba94ba4b6e3b2fbc25954cf', 'request_id': 'req-26740dea-699d-4bc6-bbc6-d12c70621152'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.108889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] The token cache is being invalidate because project 277297353ba94ba4b6e3b2fbc25954cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:19.109321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.110128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.113125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 895/1805] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:18 2022] DELETE /identity/v3/projects/277297353ba94ba4b6e3b2fbc25954cf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:19.118104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:19.119725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:19.187264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:19.222136 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26740dea-699d-4bc6-bbc6-d12c70621152 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:19.232597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f28a8c-b3f1-4f36-83b5-bb4345c4b6f4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:19.235876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:19.238207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:19.239794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:19.240871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] PATH_INFO: `/v3/users/9cc66379d20b4e348ad3714e90dd78a0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:19.248417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc66379d20b4e348ad3714e90dd78a0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:19.253768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:19.258087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:19.259182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:19.266632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:19.266632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:19.266913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:19.270821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:19.299464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 911/1806] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:19.300483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:19.303227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:19.329528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eeefb-b7a2-45c6-a6ac-14f236a3a74c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:19.335176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ae5d9-9246-41e9-8fe0-525d7f2474d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:19.336058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae5d9-9246-41e9-8fe0-525d7f2474d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:19.336348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae5d9-9246-41e9-8fe0-525d7f2474d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:19.336698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae5d9-9246-41e9-8fe0-525d7f2474d3 admin admin] PATH_INFO: `/v3/projects/56c5c7b47d5440e8bd07c73236bc605e/users/e05b2ba366b94dd6bea76f21e34ca900/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:19.338811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ae5d9-9246-41e9-8fe0-525d7f2474d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c5c7b47d5440e8bd07c73236bc605e, user_id=e05b2ba366b94dd6bea76f21e34ca900, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:19.342465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ae5d9-9246-41e9-8fe0-525d7f2474d3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:19.355080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 912/1807] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:19 2022] PUT /identity/v3/projects/56c5c7b47d5440e8bd07c73236bc605e/users/e05b2ba366b94dd6bea76f21e34ca900/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:19.355435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc66379d20b4e348ad3714e90dd78a0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.365925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:19.366190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:19.366543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:19.377877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc66379d20b4e348ad3714e90dd78a0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.379270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc66379d20b4e348ad3714e90dd78a0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.380827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc66379d20b4e348ad3714e90dd78a0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.412739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc66379d20b4e348ad3714e90dd78a0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:19.443446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] MFA Rules not processed for user `e05b2ba366b94dd6bea76f21e34ca900`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:19.444835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:19.459213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 896/1808] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:19 2022] DELETE /identity/v3/users/9cc66379d20b4e348ad3714e90dd78a0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:19.470022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:19.670259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 913/1809] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:19.718038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:19.719717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:19.870320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747d094-1adb-4cff-b48d-2de749cfaf4d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:19.880864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa90ae-2341-4541-9d9c-aa155336d6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:19.884815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa90ae-2341-4541-9d9c-aa155336d6cd service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:19.885154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa90ae-2341-4541-9d9c-aa155336d6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:19.885533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa90ae-2341-4541-9d9c-aa155336d6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:20.008723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa90ae-2341-4541-9d9c-aa155336d6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:20.012943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa90ae-2341-4541-9d9c-aa155336d6cd service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:20.033273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 897/1810] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:20.218204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:20.223675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:20.328891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ec83c-2ca4-4237-b438-d659b5b833b6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:20.412247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:20.413364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:20.414164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:20.414164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] PATH_INFO: `/v3/projects/d37460b1d9be44398e4373ef2a85e311` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:20.415523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37460b1d9be44398e4373ef2a85e311)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:20.417894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:20.499334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37460b1d9be44398e4373ef2a85e311', 'request_id': 'req-b0d2ff47-0748-453d-90ce-d4d954c7b50a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:20.507882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:20.511063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37460b1d9be44398e4373ef2a85e311', 'request_id': 'req-b0d2ff47-0748-453d-90ce-d4d954c7b50a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:20.522958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37460b1d9be44398e4373ef2a85e311', 'request_id': 'req-b0d2ff47-0748-453d-90ce-d4d954c7b50a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:20.556940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] The token cache is being invalidate because project d37460b1d9be44398e4373ef2a85e311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:20.557272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:20.560759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0d2ff47-0748-453d-90ce-d4d954c7b50a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:20.562702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 914/1811] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:20 2022] DELETE /identity/v3/projects/d37460b1d9be44398e4373ef2a85e311 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:20.568684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36bb0-8800-406a-a7c2-4b4c8faaec2e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:20.569916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36bb0-8800-406a-a7c2-4b4c8faaec2e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:20.570490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc36bb0-8800-406a-a7c2-4b4c8faaec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:20.596603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:20.609465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7dc36bb0-8800-406a-a7c2-4b4c8faaec2e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:20.610810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7dc36bb0-8800-406a-a7c2-4b4c8faaec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:20.732850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 898/1812] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:20.741461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2a728-78e2-4693-b746-cc548b7abe9b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:20.741751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2a728-78e2-4693-b746-cc548b7abe9b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:20.742036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2a728-78e2-4693-b746-cc548b7abe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:20.792877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-66b2a728-78e2-4693-b746-cc548b7abe9b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:20.798352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-66b2a728-78e2-4693-b746-cc548b7abe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:20.827563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 915/1813] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:20.840493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc36bb0-8800-406a-a7c2-4b4c8faaec2e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:20.876578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc36bb0-8800-406a-a7c2-4b4c8faaec2e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:20.920144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:20.925636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:20.925956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:20.929637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:20.930666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:20.931386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:20.934051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:20.956587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 899/1814] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:20.961629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2a728-78e2-4693-b746-cc548b7abe9b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:20.978503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2a728-78e2-4693-b746-cc548b7abe9b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:20.987817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:20.989635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:20.990069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:20.990494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:20.991344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:20.993677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:21.084023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 916/1815] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:20 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:21.098420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:21.110034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cb10b-8fd5-4adc-90da-b8afee043561 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:21.254325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:21.255107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:21.255461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:21.255806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:21.256579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:21.258772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:21.305210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 900/1816] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:21 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:21.310421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:21.323594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f8f60-fe27-4dd3-97e9-c2c7cb7b8a51 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:21.330651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:21.332556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:21.333241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:21.333756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:21.334631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:21.336645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:21.351396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 917/1817] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:21.356408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:21.373279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45df17-6d8a-46d7-9aef-7c40b7714f98 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:21.380566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a481f5-c615-472a-a05a-6d34a7d53b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:21.381879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a481f5-c615-472a-a05a-6d34a7d53b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:21.382190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a481f5-c615-472a-a05a-6d34a7d53b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:21.382497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a481f5-c615-472a-a05a-6d34a7d53b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:21.383201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a481f5-c615-472a-a05a-6d34a7d53b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:21.384866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a481f5-c615-472a-a05a-6d34a7d53b3b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:21.399261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 901/1818] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:21.403983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:21.420453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa2a2a-cbd3-4483-a63f-8e5f28bfbefb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:21.428947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:21.429974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:21.430269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:21.430555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] PATH_INFO: `/v3/projects/4a02f165f1d34ccb87a0a1c6a28aa935/users/ebe9dc1d59724078916476b51c5a3341/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:21.482441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a02f165f1d34ccb87a0a1c6a28aa935, user_id=ebe9dc1d59724078916476b51c5a3341, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:21.486058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:21.516321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 918/1819] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:21 2022] PUT /identity/v3/projects/4a02f165f1d34ccb87a0a1c6a28aa935/users/ebe9dc1d59724078916476b51c5a3341/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:21.527447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389b7a-03f6-4ccf-b392-01d1f82c84c3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:21.527730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389b7a-03f6-4ccf-b392-01d1f82c84c3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:21.528005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e389b7a-03f6-4ccf-b392-01d1f82c84c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:21.573640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8e389b7a-03f6-4ccf-b392-01d1f82c84c3 None None] MFA Rules not processed for user `ebe9dc1d59724078916476b51c5a3341`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:21.575532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e389b7a-03f6-4ccf-b392-01d1f82c84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:21.715428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 902/1820] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:21.727735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:21.844446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64698d3-eecf-4251-a992-3b11b96996a4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:21.849666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:21.850373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:21.850653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:21.851070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:21.851777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:21.853749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:21.881589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 919/1821] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:21 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:21.886343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e389b7a-03f6-4ccf-b392-01d1f82c84c3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:21.892648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:21.900427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e389b7a-03f6-4ccf-b392-01d1f82c84c3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:22.040846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:22.042799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.043145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.043835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.046662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:22.049590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:22.108721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 903/1822] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:21 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:22.112975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:22.128647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5f389-379f-4640-bded-740d0937f4f2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:22.139712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:22.140782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.141613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.142174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.143330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:22.145533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:22.162823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 920/1823] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:22.167463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:22.187516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95331-28a6-4879-899b-8e1e8e552ce4 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:22.200029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:22.200637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.200881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.201192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] PATH_INFO: `/v3/projects/bb748dcb15b14a07b38735ff338d4682/users/4396b48598414f7eb0e3d5343d204dd6/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.259365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb748dcb15b14a07b38735ff338d4682, user_id=4396b48598414f7eb0e3d5343d204dd6, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:22.267431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:22.305274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 904/1824] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:22 2022] PUT /identity/v3/projects/bb748dcb15b14a07b38735ff338d4682/users/4396b48598414f7eb0e3d5343d204dd6/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:22.309849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:22.330218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b66c644-8d92-43db-951e-8a1b89506701 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:22.424943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:22.439151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:22.440201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.440865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.441438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.442696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:22.444909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:22.460797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 921/1825] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:22.465737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:22.479548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867acdb-ae8e-47a4-9625-645af6d9895b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:22.484566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce436af-94ef-4326-b3d4-a699086e7ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:22.485514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce436af-94ef-4326-b3d4-a699086e7ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.485832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce436af-94ef-4326-b3d4-a699086e7ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.486195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce436af-94ef-4326-b3d4-a699086e7ef6 admin admin] PATH_INFO: `/v3/projects/bb748dcb15b14a07b38735ff338d4682/users/4396b48598414f7eb0e3d5343d204dd6/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.488181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce436af-94ef-4326-b3d4-a699086e7ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb748dcb15b14a07b38735ff338d4682, user_id=4396b48598414f7eb0e3d5343d204dd6, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:22.490840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce436af-94ef-4326-b3d4-a699086e7ef6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:22.504945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 905/1826] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:22 2022] PUT /identity/v3/projects/bb748dcb15b14a07b38735ff338d4682/users/4396b48598414f7eb0e3d5343d204dd6/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:22.513122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:22.515137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:22.516334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.516634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.516915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.529827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc118ec6-3ed1-456a-afa6-b98578acecda admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:22.544676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] MFA Rules not processed for user `4396b48598414f7eb0e3d5343d204dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:22.545962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:22.592556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:22.593468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.593756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.594032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] PATH_INFO: `/v3/users/a35b6651f5c6413389c5cb07aece4bc2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.595261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35b6651f5c6413389c5cb07aece4bc2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:22.597400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:22.633541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 906/1827] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:22.651293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:22.654639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:22.670392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35b6651f5c6413389c5cb07aece4bc2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:22.684507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35b6651f5c6413389c5cb07aece4bc2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:22.685699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35b6651f5c6413389c5cb07aece4bc2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:22.701491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35b6651f5c6413389c5cb07aece4bc2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:22.702347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6ca50211-34e7-457a-a4c4-0699be764980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35b6651f5c6413389c5cb07aece4bc2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:22.705644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:22.720881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 922/1828] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:22 2022] DELETE /identity/v3/users/a35b6651f5c6413389c5cb07aece4bc2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:22.723894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a6395-a0ba-43e9-b571-8eaee0897de3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:22.725380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.725761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.726095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.750464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:22.751792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:22.797848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:22.798664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:22.799179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:22.799657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:22.802223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:22.841836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 923/1829] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:22.858595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:22.860379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:22.883019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:22.907443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:22.908959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:22.920977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 907/1830] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:22.988267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda481a8-8ac3-4937-93fd-9d96193bedac None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:23.002997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:23.004269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:23.004949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:23.005284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:23.005554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:23.010246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:23.022132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:23.024527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:23.027757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fa7cb-8d51-4194-88a2-e55ef41ac809 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:23.039376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:23.040160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:23.040517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:23.040859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:23.041312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 924/1831] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:23.057095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:23.183731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:23.185528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:23.198910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 908/1832] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:23.861943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:23.864347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:23.894270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24cf33-f342-4ee9-b13a-64a4765745b2 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:23.907084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:23.925058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:23.925749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:23.926862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] PATH_INFO: `/v3/projects/94c6c8a9c45440f8a86f3850a5cc7985` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:23.930876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] RBAC: Authorizing `identity:delete_project(project_id=94c6c8a9c45440f8a86f3850a5cc7985)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:23.951444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:23.986288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:23.987861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.005751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870de09-0288-438d-b45a-c3d23a915f3e service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:24.011587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:24.012671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.013121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.013593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] PATH_INFO: `/v3/users/2b490beeecfb4e31bfa48747608687cc` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.015094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b490beeecfb4e31bfa48747608687cc)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:24.017414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:24.050732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94c6c8a9c45440f8a86f3850a5cc7985', 'request_id': 'req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.056971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94c6c8a9c45440f8a86f3850a5cc7985', 'request_id': 'req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.065582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94c6c8a9c45440f8a86f3850a5cc7985', 'request_id': 'req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.066592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:24.074587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b490beeecfb4e31bfa48747608687cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.079896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] The token cache is being invalidate because project 94c6c8a9c45440f8a86f3850a5cc7985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:24.080172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.081329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.083021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 925/1833] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:23 2022] DELETE /identity/v3/projects/94c6c8a9c45440f8a86f3850a5cc7985 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:24.086531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:24.086531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.114135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b490beeecfb4e31bfa48747608687cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.115150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b490beeecfb4e31bfa48747608687cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.115932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b490beeecfb4e31bfa48747608687cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.125957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b490beeecfb4e31bfa48747608687cc'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.158335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 909/1834] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:23 2022] DELETE /identity/v3/users/2b490beeecfb4e31bfa48747608687cc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:24.159532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:24.161259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.225847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42d498-4efb-4d07-9cf4-a59d7fa0756c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:24.252673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a9d9c-26e3-4a14-8413-f7803e184aa7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:24.260333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:24.262598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.262952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.263394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] PATH_INFO: `/v3/users/e05b2ba366b94dd6bea76f21e34ca900` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.265671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05b2ba366b94dd6bea76f21e34ca900)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:24.269529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:24.297041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:24.334040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:24.336736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.338299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.339765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] PATH_INFO: `/v3/users/cdb93ea699b44eb7bb6306e3e81992d2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.341568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb93ea699b44eb7bb6306e3e81992d2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:24.344055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:24.349463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05b2ba366b94dd6bea76f21e34ca900'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.364543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05b2ba366b94dd6bea76f21e34ca900'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.365885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05b2ba366b94dd6bea76f21e34ca900'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.367078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05b2ba366b94dd6bea76f21e34ca900'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.377683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-362f4b58-a816-44b5-adb3-c46acba00b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05b2ba366b94dd6bea76f21e34ca900'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.414617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 910/1835] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:24 2022] DELETE /identity/v3/users/e05b2ba366b94dd6bea76f21e34ca900 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:24.417009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.417377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.417708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.444711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:24.447200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.504131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:24.528230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb93ea699b44eb7bb6306e3e81992d2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.536926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb93ea699b44eb7bb6306e3e81992d2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.538028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb93ea699b44eb7bb6306e3e81992d2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.553317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 911/1836] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:24.562626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb93ea699b44eb7bb6306e3e81992d2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.563634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-51adc6ad-e59a-4c08-a338-8ada3c614093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb93ea699b44eb7bb6306e3e81992d2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:24.564222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:24.566378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.578204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 926/1837] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:24 2022] DELETE /identity/v3/users/cdb93ea699b44eb7bb6306e3e81992d2 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:24.583162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.583452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.583871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.619245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:24.622510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.692543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bde1-3ce5-4beb-97d2-0aacfb26316d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:24.757239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eed1d8-d577-41ef-a2dd-6960b718413d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:24.757941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed1d8-d577-41ef-a2dd-6960b718413d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.758300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed1d8-d577-41ef-a2dd-6960b718413d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.758582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eed1d8-d577-41ef-a2dd-6960b718413d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.786250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 927/1838] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:24.798469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:24.800027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.818351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bfe2c-65ab-4311-b79e-2316876b2163 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:24.823509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:24.824301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.825748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.826102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.859946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:24.861427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:24.872851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 928/1839] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:24.873771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:24.875484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:24.898496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eed1d8-d577-41ef-a2dd-6960b718413d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:24.900168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eed1d8-d577-41ef-a2dd-6960b718413d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:24.908255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb5481-93a1-44c6-82c5-1197000a69f3 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:24.917624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 912/1840] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:24.920368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:24.920951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:24.921239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:24.921736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] PATH_INFO: `/v3/projects/56c5c7b47d5440e8bd07c73236bc605e` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:24.923327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c5c7b47d5440e8bd07c73236bc605e)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:24.925843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:24.991106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:24.997337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c5c7b47d5440e8bd07c73236bc605e', 'request_id': 'req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.008861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c5c7b47d5440e8bd07c73236bc605e', 'request_id': 'req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.019680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c5c7b47d5440e8bd07c73236bc605e', 'request_id': 'req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.052466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] The token cache is being invalidate because project 56c5c7b47d5440e8bd07c73236bc605e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:25.053560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.056006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6d2e3e37-858a-47c5-8e9d-96b0bd2188e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.060818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 929/1841] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:24 2022] DELETE /identity/v3/projects/56c5c7b47d5440e8bd07c73236bc605e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:25.066572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d361e-7f1d-4c07-bcbf-a97733e46720 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:25.066572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d361e-7f1d-4c07-bcbf-a97733e46720 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:25.067789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d361e-7f1d-4c07-bcbf-a97733e46720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:25.119370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-322d361e-7f1d-4c07-bcbf-a97733e46720 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:25.124836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-322d361e-7f1d-4c07-bcbf-a97733e46720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:25.239734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:25.298392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 913/1842] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:25.302860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:25.303122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:25.303390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:25.334426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:25.335949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:25.350912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 930/1843] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:25.359146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d361e-7f1d-4c07-bcbf-a97733e46720 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:25.374551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d361e-7f1d-4c07-bcbf-a97733e46720 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:25.391706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:25.393108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:25.394060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:25.394576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:25.395713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:25.396740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:25.399951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:25.401914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:25.403972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:25.496314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad0d61-e12f-4282-b313-7cc71e561f0c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:25.514125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:25.514938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:25.515221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:25.515576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] PATH_INFO: `/v3/projects/d539419a8e134302b4817401d063bab6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:25.519569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 914/1844] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:25.519569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:25.519767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d539419a8e134302b4817401d063bab6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:25.520837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:25.523127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:25.573847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2195f-4153-4af3-a03b-8e4ddafa4110 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:25.581200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:25.582480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:25.582764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:25.583041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] PATH_INFO: `/v3/projects/2b7acfc87add4980825bfe4ddc32d8e0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:25.584868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7acfc87add4980825bfe4ddc32d8e0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:25.587320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:25.686945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd539419a8e134302b4817401d063bab6', 'request_id': 'req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.700805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7acfc87add4980825bfe4ddc32d8e0', 'request_id': 'req-73ebd267-2db4-4cc8-a141-d6dfdcc08288'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.711330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd539419a8e134302b4817401d063bab6', 'request_id': 'req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.723526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd539419a8e134302b4817401d063bab6', 'request_id': 'req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.739117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7acfc87add4980825bfe4ddc32d8e0', 'request_id': 'req-73ebd267-2db4-4cc8-a141-d6dfdcc08288'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.758024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7acfc87add4980825bfe4ddc32d8e0', 'request_id': 'req-73ebd267-2db4-4cc8-a141-d6dfdcc08288'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.759938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] The token cache is being invalidate because project d539419a8e134302b4817401d063bab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:25.760383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.764326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.773627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 931/1845] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:25 2022] DELETE /identity/v3/projects/d539419a8e134302b4817401d063bab6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:25.776304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:25.783906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:25.809669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] The token cache is being invalidate because project 2b7acfc87add4980825bfe4ddc32d8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:25.813163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.814890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:25.820343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 915/1846] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:25 2022] DELETE /identity/v3/projects/2b7acfc87add4980825bfe4ddc32d8e0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:25.828497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:25.833332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:25.962496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623a5b9-dd27-4ada-9cbc-f8cc170f5226 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.016205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebd267-2db4-4cc8-a141-d6dfdcc08288 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.036566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.039215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.043634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.044156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] PATH_INFO: `/v3/users/9b4d61685b2548368da30518db4a1fd9` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.046724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4d61685b2548368da30518db4a1fd9)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.051054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.051805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:26.060463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.061198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.061797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.061920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.062930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.074427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.124919 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 932/1847] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:25 2022] POST /identity/v3/projects => generated 387 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:26.125760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.129994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:26.160284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4d61685b2548368da30518db4a1fd9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.175598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4d61685b2548368da30518db4a1fd9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.176233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4d61685b2548368da30518db4a1fd9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.176894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4d61685b2548368da30518db4a1fd9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.179471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:26.194881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4d61685b2548368da30518db4a1fd9'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.236123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 916/1848] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:25 2022] DELETE /identity/v3/users/9b4d61685b2548368da30518db4a1fd9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:26.237648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.242733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:26.315526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc5c26-0a6d-45cc-b28e-adadee02b40e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.329239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333f957-8175-44fa-b16f-14f41a59975c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.335466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.335644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.336370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.336477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.336655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.336861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.336958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] PATH_INFO: `/v3/users/da5d8b0248264444b499c0d7181056fb` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.337129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.338218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.339646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5d8b0248264444b499c0d7181056fb)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.341106 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.341762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.377262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 917/1849] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:26 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:26.378331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.392229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a6f98-12c1-4cd6-84dd-d1a5562bf705 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.397742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.398649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.399611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.399825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.401993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.404580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.421292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 918/1850] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:26.426294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.443227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e713ca-3aa0-4bc6-b102-d066e709d50f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.451188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5d8b0248264444b499c0d7181056fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.471503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.472208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.472490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.472769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.497816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.504263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.509187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5d8b0248264444b499c0d7181056fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.510027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5d8b0248264444b499c0d7181056fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.563539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5d8b0248264444b499c0d7181056fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.567625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5d8b0248264444b499c0d7181056fb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:26.573031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 919/1851] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:26.574456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.584003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:26.602057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 933/1852] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:26 2022] DELETE /identity/v3/users/da5d8b0248264444b499c0d7181056fb => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:26.602985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.606438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:26.693858 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402f3b7-cd4c-44ae-a7ca-4f9c14e9e1f3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.762745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a54d67-a8e4-480e-a108-31ab6d599b29 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.766954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.767682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.767968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.768253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.779368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:26.799999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.801526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.818494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 934/1853] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:26.819394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.837045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:26.854780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.858137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.858443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.859869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.873973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98339edc-dea4-46ff-aa95-935c52f77c4a service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:26.891547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:26.892221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:26.892546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:26.892827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:26.895897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.899176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.903055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:26.908026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:26.909611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:26.925688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 935/1854] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:26.925831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 920/1855] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:26.926517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.927109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:26.930324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:26.939282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:27.110734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf5ecc-c1fc-40b6-8d0e-803564d2f7c8 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.115923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60bd42-14d1-45f9-9888-0d9f0d679e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:27.116838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60bd42-14d1-45f9-9888-0d9f0d679e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.117480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60bd42-14d1-45f9-9888-0d9f0d679e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.117661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60bd42-14d1-45f9-9888-0d9f0d679e45 admin admin] PATH_INFO: `/v3/projects/295c7f8be7134ed79bbe195a5b773193/users/b12814e8969444fc93748c4d508cf5d5/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.158932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60bd42-14d1-45f9-9888-0d9f0d679e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295c7f8be7134ed79bbe195a5b773193, user_id=b12814e8969444fc93748c4d508cf5d5, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:27.161812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60bd42-14d1-45f9-9888-0d9f0d679e45 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:27.181596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4049f4-3a02-4dd5-90c1-ebcd10c4e37e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.197037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 936/1856] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:26 2022] PUT /identity/v3/projects/295c7f8be7134ed79bbe195a5b773193/users/b12814e8969444fc93748c4d508cf5d5/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:27.203325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fc537-5cf4-4026-9887-524696b7a113 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.204032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fc537-5cf4-4026-9887-524696b7a113 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.204032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fc537-5cf4-4026-9887-524696b7a113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.263939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-137fc537-5cf4-4026-9887-524696b7a113 None None] MFA Rules not processed for user `b12814e8969444fc93748c4d508cf5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:27.268352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-137fc537-5cf4-4026-9887-524696b7a113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:27.363001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:27.365928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.366263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.366548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] PATH_INFO: `/v3/projects/921fc21ef6e446efa8ab0169695e303f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.371608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=921fc21ef6e446efa8ab0169695e303f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:27.381200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:27.392630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 937/1857] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:27.398726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fc537-5cf4-4026-9887-524696b7a113 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:27.414138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fc537-5cf4-4026-9887-524696b7a113 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.421836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:27.422772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.423151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.423531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.424316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:27.427221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:27.470732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 938/1858] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:27 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:27.471788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:27.508172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921fc21ef6e446efa8ab0169695e303f', 'request_id': 'req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:27.525718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921fc21ef6e446efa8ab0169695e303f', 'request_id': 'req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:27.542103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921fc21ef6e446efa8ab0169695e303f', 'request_id': 'req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:27.549164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:27.576286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44dd43-7430-4def-ac2a-aea055f709a1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.577958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] The token cache is being invalidate because project 921fc21ef6e446efa8ab0169695e303f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:27.579610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:27.582157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3f4cfd3a-e1d9-456b-8d97-e8c1482df193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:27.585528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 921/1859] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:26 2022] DELETE /identity/v3/projects/921fc21ef6e446efa8ab0169695e303f => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:27.595483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1253f4-c796-4aeb-a2af-e329abbcc736 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.597230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1253f4-c796-4aeb-a2af-e329abbcc736 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.597543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1253f4-c796-4aeb-a2af-e329abbcc736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.653002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9b1253f4-c796-4aeb-a2af-e329abbcc736 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:27.655385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9b1253f4-c796-4aeb-a2af-e329abbcc736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:27.661259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:27.662003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.662295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.662624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.663454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:27.665932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:27.695137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 922/1860] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:27.699248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 939/1861] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:27 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:27.699729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898ad2-b24c-4509-8bdf-2b97ffea9ef9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.700028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898ad2-b24c-4509-8bdf-2b97ffea9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.700424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898ad2-b24c-4509-8bdf-2b97ffea9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.701105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:27.703548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:27.725029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5744c-328c-48a1-bc6a-eeaa45fb621e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.731679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:27.732440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.732730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.733014 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.733877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:27.735721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:27.753622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f1898ad2-b24c-4509-8bdf-2b97ffea9ef9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:27.756663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1898ad2-b24c-4509-8bdf-2b97ffea9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:27.772330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 940/1862] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:27.773573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:27.779135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 923/1863] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:27.784357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1898ad2-b24c-4509-8bdf-2b97ffea9ef9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:27.796717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f292e-bfb3-4561-b530-788dc7205062 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.806972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:27.810874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.810874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.810874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] PATH_INFO: `/v3/projects/fc3a1004b69e408aafb50fc2d4964b6b/users/63de364357724ac086fcb1bcb7656bb0/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.812748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1898ad2-b24c-4509-8bdf-2b97ffea9ef9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.826907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:27.827606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:27.827881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:27.830177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:27.831948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:27.832260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:27.836216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:27.862131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3a1004b69e408aafb50fc2d4964b6b, user_id=63de364357724ac086fcb1bcb7656bb0, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:27.865620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:27.872131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 924/1864] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:27.872131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:27.874500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:27.893016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 941/1865] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:27 2022] PUT /identity/v3/projects/fc3a1004b69e408aafb50fc2d4964b6b/users/63de364357724ac086fcb1bcb7656bb0/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:27.897030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:27.910702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d786-2eac-4ecf-8883-94025bffa099 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:27.916503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:28.002886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289375e-3faf-4f09-89e6-dfcc65c5cc27 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.007773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.008570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.008703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.008892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.009134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.009488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.009771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.009880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.010041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] PATH_INFO: `/v3/projects/6e9400fa9c064c7daac958775a38cae8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.011291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9400fa9c064c7daac958775a38cae8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.012017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.013199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.046741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 942/1866] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:27 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:28.046741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.075324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9400fa9c064c7daac958775a38cae8', 'request_id': 'req-213e9ebd-cbf5-46b3-8908-41dec8ba344f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.081810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:28.086537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9400fa9c064c7daac958775a38cae8', 'request_id': 'req-213e9ebd-cbf5-46b3-8908-41dec8ba344f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.098582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9400fa9c064c7daac958775a38cae8', 'request_id': 'req-213e9ebd-cbf5-46b3-8908-41dec8ba344f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.112752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] The token cache is being invalidate because project 6e9400fa9c064c7daac958775a38cae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:28.113074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.114499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.115852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 925/1867] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:27 2022] DELETE /identity/v3/projects/6e9400fa9c064c7daac958775a38cae8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:28.116446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.118073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.129476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5647d88-0b85-4bcb-9476-f722b69a6b14 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.202010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.202723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.203050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.203334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.204760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e9ebd-cbf5-46b3-8908-41dec8ba344f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.205211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.206463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.214465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.215353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.215638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.215917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] PATH_INFO: `/v3/users/ebe9dc1d59724078916476b51c5a3341` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.217677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebe9dc1d59724078916476b51c5a3341)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.219990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.225759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 943/1868] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:28.227591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.231040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.251137 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a799c-c0a3-4532-9c46-8d9dcdb7490b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.266452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e2621-5178-4359-8bcb-191cab8feb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.267366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2621-5178-4359-8bcb-191cab8feb0b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.267635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2621-5178-4359-8bcb-191cab8feb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.268041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2621-5178-4359-8bcb-191cab8feb0b admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.269182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e2621-5178-4359-8bcb-191cab8feb0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.271932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e2621-5178-4359-8bcb-191cab8feb0b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.298678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 944/1869] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:28 2022] POST /identity/v3/users => generated 288 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:28.300835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.301121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.301503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.303666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:28.311906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebe9dc1d59724078916476b51c5a3341'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.326054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebe9dc1d59724078916476b51c5a3341'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.327121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebe9dc1d59724078916476b51c5a3341'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.327786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebe9dc1d59724078916476b51c5a3341'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.330265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:28.331798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.342846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebe9dc1d59724078916476b51c5a3341'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:28.354683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 945/1870] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:28.354683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.354683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.365594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9b12f-96c5-42be-b9b1-a3623af3662a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.372727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 926/1871] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:28 2022] DELETE /identity/v3/users/ebe9dc1d59724078916476b51c5a3341 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:28.373895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.376094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.475162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890ac8-bb6f-4bb1-87eb-f377eb3b928d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.483072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f302ca5-11dc-4289-9e22-a42a56f30c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.483985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302ca5-11dc-4289-9e22-a42a56f30c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.484262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302ca5-11dc-4289-9e22-a42a56f30c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.484535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f302ca5-11dc-4289-9e22-a42a56f30c3d admin admin] PATH_INFO: `/v3/projects/fc3a1004b69e408aafb50fc2d4964b6b/users/63de364357724ac086fcb1bcb7656bb0/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.484930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574750e3-5428-4c28-8eae-97325f16e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.485816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574750e3-5428-4c28-8eae-97325f16e5be admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.486259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574750e3-5428-4c28-8eae-97325f16e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.486835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574750e3-5428-4c28-8eae-97325f16e5be admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.487209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f302ca5-11dc-4289-9e22-a42a56f30c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3a1004b69e408aafb50fc2d4964b6b, user_id=63de364357724ac086fcb1bcb7656bb0, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.487997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574750e3-5428-4c28-8eae-97325f16e5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.489898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f302ca5-11dc-4289-9e22-a42a56f30c3d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.490287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574750e3-5428-4c28-8eae-97325f16e5be admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.508267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 927/1872] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:28.511506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31677497-4951-46b8-a6d8-a01a3669837a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.511851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31677497-4951-46b8-a6d8-a01a3669837a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.512082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31677497-4951-46b8-a6d8-a01a3669837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.527226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 946/1873] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:28 2022] PUT /identity/v3/projects/fc3a1004b69e408aafb50fc2d4964b6b/users/63de364357724ac086fcb1bcb7656bb0/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:28.529059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a203b-8498-462c-80ac-a9cbc9ba2830 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.529373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a203b-8498-462c-80ac-a9cbc9ba2830 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.529657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a203b-8498-462c-80ac-a9cbc9ba2830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.539072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-31677497-4951-46b8-a6d8-a01a3669837a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:28.540715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-31677497-4951-46b8-a6d8-a01a3669837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.580820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ca6a203b-8498-462c-80ac-a9cbc9ba2830 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:28.582252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ca6a203b-8498-462c-80ac-a9cbc9ba2830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.627433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 928/1874] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:28.628107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31677497-4951-46b8-a6d8-a01a3669837a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.644162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31677497-4951-46b8-a6d8-a01a3669837a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.657223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d888d-11bf-4f11-8042-04cab8f1c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.658125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d888d-11bf-4f11-8042-04cab8f1c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.658421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d888d-11bf-4f11-8042-04cab8f1c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.658837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d888d-11bf-4f11-8042-04cab8f1c4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.659442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d888d-11bf-4f11-8042-04cab8f1c4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.666225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d888d-11bf-4f11-8042-04cab8f1c4fb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.696110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 929/1875] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:28.696110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.696110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.696110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.707441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:28.733017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] MFA Rules not processed for user `63de364357724ac086fcb1bcb7656bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:28.734861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.747123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 947/1876] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:28.751286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a203b-8498-462c-80ac-a9cbc9ba2830 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.767690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a203b-8498-462c-80ac-a9cbc9ba2830 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.783591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.785193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.785873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.786406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.787312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:28.787798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.790309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.802120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:28.825206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 948/1877] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:28.825206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.840485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75bc66-f544-40ee-8e16-cfb8a96221de admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:28.846456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:28.847758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:28.848955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:28.849556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] PATH_INFO: `/v3/projects/b3ff78df390b47d787df90c1a36d3466/users/da3b04f9543f44f8bbb6bb06e68efc22/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:28.872002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 930/1878] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:28.872998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.875209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:28.880746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ff78df390b47d787df90c1a36d3466, user_id=da3b04f9543f44f8bbb6bb06e68efc22, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:28.887522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:28.907896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 949/1879] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:28 2022] PUT /identity/v3/projects/b3ff78df390b47d787df90c1a36d3466/users/da3b04f9543f44f8bbb6bb06e68efc22/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:28.908879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:28.963641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb21c9-194e-4e63-b9c9-9e3cd5eadf19 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.021712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268f8ab-b287-4ea7-a789-381534dc9ffc admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.027704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.028512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.028812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.029085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.029822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.031750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.047606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2abe65-7e75-4f25-af22-e251e167f0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.048714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2abe65-7e75-4f25-af22-e251e167f0dc service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.049151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2abe65-7e75-4f25-af22-e251e167f0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.050054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2abe65-7e75-4f25-af22-e251e167f0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.063268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 950/1880] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:28 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:29.064524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:29.067367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2abe65-7e75-4f25-af22-e251e167f0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.068353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:29.069761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2abe65-7e75-4f25-af22-e251e167f0dc service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.097541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 931/1881] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:29.099229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf55b89-60e2-4938-8bfe-4d51faed24bd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.099641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf55b89-60e2-4938-8bfe-4d51faed24bd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.100036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf55b89-60e2-4938-8bfe-4d51faed24bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.161863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bdf55b89-60e2-4938-8bfe-4d51faed24bd None None] MFA Rules not processed for user `da3b04f9543f44f8bbb6bb06e68efc22`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:29.164624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bdf55b89-60e2-4938-8bfe-4d51faed24bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:29.200784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6934f-70ee-40c2-9c92-7ad35d69bb27 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.211422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.212103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.212571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.212865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.281731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 932/1882] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:29.283075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf55b89-60e2-4938-8bfe-4d51faed24bd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:29.306398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:29.334442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:29.334696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.336854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.372153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 951/1883] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:29.374653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:29.376415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:29.406678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a78c7-8db3-4cbb-a27e-ee65fa6479be service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.416361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.417603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.417894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.418216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.428168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf55b89-60e2-4938-8bfe-4d51faed24bd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.435445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.436908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.444350 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.445051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.445335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.445638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.446345 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.449273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.463438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 952/1884] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:29.504410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 933/1885] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:29 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:29.509097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:29.520068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:29.533080 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807121e6-1948-4fcf-af63-81ced00c0f38 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.538330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54af04-c8d2-438f-8634-cd584c0b532a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.545837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.547450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.548221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.548678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.549125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.550144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.551112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.552916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.553391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.553929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] PATH_INFO: `/v3/users/b12814e8969444fc93748c4d508cf5d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.556843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12814e8969444fc93748c4d508cf5d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.560324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.578030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 953/1886] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:29.582300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:29.609760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa33e10-3e0f-4919-8fbe-85421b74a7e1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.629273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b54b5a-6c64-4421-82ce-a2102a67a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.629922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54b5a-6c64-4421-82ce-a2102a67a8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.630686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54b5a-6c64-4421-82ce-a2102a67a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.630976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b54b5a-6c64-4421-82ce-a2102a67a8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.631728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b54b5a-6c64-4421-82ce-a2102a67a8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.633409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b54b5a-6c64-4421-82ce-a2102a67a8e5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.673279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 954/1887] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:29.675340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33c72-a4bf-46d8-9723-f92dda9f4480 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.676822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33c72-a4bf-46d8-9723-f92dda9f4480 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.678707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33c72-a4bf-46d8-9723-f92dda9f4480 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.682849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 955/1888] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:08:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:08:29.683521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12814e8969444fc93748c4d508cf5d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:29.686181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33c72-a4bf-46d8-9723-f92dda9f4480 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:29.705862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12814e8969444fc93748c4d508cf5d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:29.706989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12814e8969444fc93748c4d508cf5d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:29.709125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12814e8969444fc93748c4d508cf5d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:29.731975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6558947c-33d9-46d9-b748-fbe0c682b582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12814e8969444fc93748c4d508cf5d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:29.735451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33c72-a4bf-46d8-9723-f92dda9f4480 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:29.749123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d554401-c965-4c3a-827b-7a06142c1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:29.750068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554401-c965-4c3a-827b-7a06142c1da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.750353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554401-c965-4c3a-827b-7a06142c1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.750635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554401-c965-4c3a-827b-7a06142c1da4 admin admin] PATH_INFO: `/v3/projects/3dcc8377915e4f60971520fb387149e4/users/9260d29108b141ce90ecbf2b20eb3a98/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.796537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 934/1889] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:29 2022] DELETE /identity/v3/users/b12814e8969444fc93748c4d508cf5d5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:29.796537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.796537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.796537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.813142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d554401-c965-4c3a-827b-7a06142c1da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcc8377915e4f60971520fb387149e4, user_id=9260d29108b141ce90ecbf2b20eb3a98, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:29.818943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d554401-c965-4c3a-827b-7a06142c1da4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:29.854343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 956/1890] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:29 2022] PUT /identity/v3/projects/3dcc8377915e4f60971520fb387149e4/users/9260d29108b141ce90ecbf2b20eb3a98/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:29.857947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f9762-960d-4f49-8536-6f57211ca8c5 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:29.858250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f9762-960d-4f49-8536-6f57211ca8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:29.859291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f9762-960d-4f49-8536-6f57211ca8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:29.870578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:29.872128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:29.915177 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2c2f9762-960d-4f49-8536-6f57211ca8c5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:29.916840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2c2f9762-960d-4f49-8536-6f57211ca8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.062307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 957/1891] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:30.064189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.064763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.065193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.077303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 935/1892] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:30.117036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.118581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.138013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] MFA Rules not processed for user `9260d29108b141ce90ecbf2b20eb3a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:30.140039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7d9cc-914b-4181-ab4c-0ec0ddbf4902 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.142235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.150320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.151721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.153880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.155897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] PATH_INFO: `/v3/projects/4a02f165f1d34ccb87a0a1c6a28aa935` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.158951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a02f165f1d34ccb87a0a1c6a28aa935)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.162818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.198281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:30.330321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a02f165f1d34ccb87a0a1c6a28aa935', 'request_id': 'req-8a63a3ca-6f66-4111-a29f-a69948c7c615'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.332403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 958/1893] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:30.346744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.350847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.354617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a02f165f1d34ccb87a0a1c6a28aa935', 'request_id': 'req-8a63a3ca-6f66-4111-a29f-a69948c7c615'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.365041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a02f165f1d34ccb87a0a1c6a28aa935', 'request_id': 'req-8a63a3ca-6f66-4111-a29f-a69948c7c615'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.370301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:30.382657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] The token cache is being invalidate because project 4a02f165f1d34ccb87a0a1c6a28aa935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:30.383087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.383962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.389483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 936/1894] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:30 2022] DELETE /identity/v3/projects/4a02f165f1d34ccb87a0a1c6a28aa935 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:30.391975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.393447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.449002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e5f15-ff92-4ae7-a854-99373bf83a14 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.493839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63a3ca-6f66-4111-a29f-a69948c7c615 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.501867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.503040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.504286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.504717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.506966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.524365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.527847 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.553996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 937/1895] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:30.554776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.561805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.595099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.596520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.596854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.597140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.599726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.656210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63130b9-b8ac-47d7-ab0f-57aace2ea167 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.663880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.664718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.665130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.665560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.666477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.671042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.705038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.706830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.719010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 938/1896] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:30 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:30.720263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.721937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:30.726709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 959/1897] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:30.727554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.728678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:30.740719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27c9be-63f4-48e3-9f4c-f765520973d0 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.830116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.830812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.832885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096229-5166-4aa9-856f-868b44fca22e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.834471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.834963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.835717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.838304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.848411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.850641 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.850933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.851218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] PATH_INFO: `/v3/users/4396b48598414f7eb0e3d5343d204dd6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.865591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4396b48598414f7eb0e3d5343d204dd6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.865591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.879192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 960/1898] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:30 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:30.880143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.893643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c07b0-9528-4ba1-81eb-805e2f30b8df admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.899887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.900506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.900851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.901331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.902983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.905271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.906895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:30.924925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 961/1899] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:30.925896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:30.938238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66f6d-853b-4a3d-ab17-6bc00a204a80 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:30.945038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:30.946385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:30.946682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:30.946966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] PATH_INFO: `/v3/projects/9ed677e185594c6888263aaf65e6a571/users/0d92695a6e4b44c1be462469b5bdf324/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:30.957480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4396b48598414f7eb0e3d5343d204dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.974787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed677e185594c6888263aaf65e6a571, user_id=0d92695a6e4b44c1be462469b5bdf324, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:30.976947 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4396b48598414f7eb0e3d5343d204dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.977851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4396b48598414f7eb0e3d5343d204dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:30.977993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:30.978748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4396b48598414f7eb0e3d5343d204dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:31.001076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 962/1900] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:30 2022] PUT /identity/v3/projects/9ed677e185594c6888263aaf65e6a571/users/0d92695a6e4b44c1be462469b5bdf324/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:31.002112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:31.004281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:31.006737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4396b48598414f7eb0e3d5343d204dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:31.035464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 939/1901] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:30 2022] DELETE /identity/v3/users/4396b48598414f7eb0e3d5343d204dd6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:31.106446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95bba1-cf8e-4842-938a-6e18831910c8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:31.181605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43100bec-51fc-4afe-8b2a-630f327f118b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:31.182734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100bec-51fc-4afe-8b2a-630f327f118b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:31.183479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100bec-51fc-4afe-8b2a-630f327f118b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:31.183761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100bec-51fc-4afe-8b2a-630f327f118b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:31.185582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100bec-51fc-4afe-8b2a-630f327f118b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:31.187391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100bec-51fc-4afe-8b2a-630f327f118b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:31.204475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 963/1902] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:31.205657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:31.218494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3b79-5c0c-40f4-9dba-5831d89f1ef9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:31.224733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:31.225707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:31.226009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:31.226286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] PATH_INFO: `/v3/projects/9ed677e185594c6888263aaf65e6a571/users/0d92695a6e4b44c1be462469b5bdf324/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:31.229573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed677e185594c6888263aaf65e6a571, user_id=0d92695a6e4b44c1be462469b5bdf324, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:31.233533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:31.261580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 940/1903] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:31 2022] PUT /identity/v3/projects/9ed677e185594c6888263aaf65e6a571/users/0d92695a6e4b44c1be462469b5bdf324/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:31.264055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:31.264574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:31.265074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:31.306582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] MFA Rules not processed for user `0d92695a6e4b44c1be462469b5bdf324`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:31.310109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:31.393752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:31.404185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 964/1904] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:31.412960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:31.415272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:31.500164 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07728fde-0676-4206-9799-13fd9e2e710d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:31.507662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:31.509032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:31.509735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:31.510879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:31.515249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:31.562627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:31.640421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:31.642144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:31.665845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 941/1905] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:32.272911 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:32.274290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:32.440068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0a4c-f06e-465b-a6dd-ca9cd3f6505f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:32.466168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:32.466168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:32.466757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:32.467059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] PATH_INFO: `/v3/projects/bb748dcb15b14a07b38735ff338d4682` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:32.472155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb748dcb15b14a07b38735ff338d4682)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:32.474152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:32.555228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:32.557390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:32.559906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb748dcb15b14a07b38735ff338d4682', 'request_id': 'req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.571187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb748dcb15b14a07b38735ff338d4682', 'request_id': 'req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.582598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296fbd4-11f6-43c7-9c62-587e30f148a0 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:32.592891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb748dcb15b14a07b38735ff338d4682', 'request_id': 'req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.627340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] The token cache is being invalidate because project bb748dcb15b14a07b38735ff338d4682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:32.627637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.629042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b6b43e0b-1ab8-4077-94b5-2b8ca65b0360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.632577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 965/1906] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:32 2022] DELETE /identity/v3/projects/bb748dcb15b14a07b38735ff338d4682 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:32.637851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff90a4-4398-4ded-8c59-cd6ab85fce48 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:32.638142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff90a4-4398-4ded-8c59-cd6ab85fce48 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:32.638426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff90a4-4398-4ded-8c59-cd6ab85fce48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:32.659033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-94ff90a4-4398-4ded-8c59-cd6ab85fce48 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:32.661239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-94ff90a4-4398-4ded-8c59-cd6ab85fce48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:32.681551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:32.683522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:32.684070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:32.684178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] PATH_INFO: `/v3/projects/295c7f8be7134ed79bbe195a5b773193` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:32.685946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=295c7f8be7134ed79bbe195a5b773193)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:32.688308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:32.737522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 966/1907] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:32.744264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb18a1-dbf3-42dc-ad73-5d3c43c1525b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:32.744778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb18a1-dbf3-42dc-ad73-5d3c43c1525b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:32.745163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb18a1-dbf3-42dc-ad73-5d3c43c1525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:32.775512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295c7f8be7134ed79bbe195a5b773193', 'request_id': 'req-20e57eef-1745-4035-a71e-c6a8863def1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.775664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0cfb18a1-dbf3-42dc-ad73-5d3c43c1525b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:32.776865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0cfb18a1-dbf3-42dc-ad73-5d3c43c1525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:32.792266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295c7f8be7134ed79bbe195a5b773193', 'request_id': 'req-20e57eef-1745-4035-a71e-c6a8863def1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.810121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295c7f8be7134ed79bbe195a5b773193', 'request_id': 'req-20e57eef-1745-4035-a71e-c6a8863def1a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.822877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:32.849603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] The token cache is being invalidate because project 295c7f8be7134ed79bbe195a5b773193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:32.849900 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.852189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:32.856611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 942/1908] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:32 2022] DELETE /identity/v3/projects/295c7f8be7134ed79bbe195a5b773193 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:32.860440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:32.868157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:32.901447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 967/1909] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:32.904268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb18a1-dbf3-42dc-ad73-5d3c43c1525b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:32.919885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb18a1-dbf3-42dc-ad73-5d3c43c1525b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:32.930802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:32.931826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:32.932671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:32.933287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:32.935640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:32.935971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:32.938076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:32.960312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 968/1910] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:32.966045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:32.978082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ee6e8-e589-4d4c-82ed-0c53d7220773 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:32.982655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:32.984020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:32.985448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:32.985965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:32.986259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:32.986966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:32.988975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:32.989860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e57eef-1745-4035-a71e-c6a8863def1a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:32.997933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:32.999732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.000030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.000565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] PATH_INFO: `/v3/users/63de364357724ac086fcb1bcb7656bb0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.003174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=63de364357724ac086fcb1bcb7656bb0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:33.005258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:33.022769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 969/1911] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:32 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:08:33.027410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.069184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63de364357724ac086fcb1bcb7656bb0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.086469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63de364357724ac086fcb1bcb7656bb0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.088105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63de364357724ac086fcb1bcb7656bb0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.089514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63de364357724ac086fcb1bcb7656bb0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.099718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63de364357724ac086fcb1bcb7656bb0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.112583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f49fe0-18e0-47d5-8237-d7c535619655 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:33.118326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:33.118603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.118875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.119118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.121227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:33.122599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:33.140938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 943/1912] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:32 2022] DELETE /identity/v3/users/63de364357724ac086fcb1bcb7656bb0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:33.160427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 970/1913] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:33 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:33.162954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.165910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:33.257165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe5f2d-76fe-4cce-bdb8-6a6a79ea76cd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:33.270471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:33.271353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.272595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.272595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.273226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:33.274885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:33.293326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.293731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 944/1914] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:33.305660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b79a4-9c5c-4a4c-8f57-83ee428fea4d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:33.311878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb3404-e538-4ae2-be1c-1cf10b5e80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:33.312972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3404-e538-4ae2-be1c-1cf10b5e80af admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.313268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3404-e538-4ae2-be1c-1cf10b5e80af admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.313609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3404-e538-4ae2-be1c-1cf10b5e80af admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.314352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb3404-e538-4ae2-be1c-1cf10b5e80af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:33.333849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb3404-e538-4ae2-be1c-1cf10b5e80af admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:33.357672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 971/1915] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:33.362922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.377808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c612d9b-5743-4970-91f7-f9e7592a63ac admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:33.383640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:33.384797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.384908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.385772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] PATH_INFO: `/v3/projects/269343703f0243d2a6c06b6bd42d3e1a/users/852562a293b544c0848d8b4c0590c744/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.402730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=269343703f0243d2a6c06b6bd42d3e1a, user_id=852562a293b544c0848d8b4c0590c744, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:33.405739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:33.427365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 945/1916] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:33 2022] PUT /identity/v3/projects/269343703f0243d2a6c06b6bd42d3e1a/users/852562a293b544c0848d8b4c0590c744/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:33.439129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd17cb-b331-4274-bbc0-4773c4c340fd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.439544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd17cb-b331-4274-bbc0-4773c4c340fd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.439937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd17cb-b331-4274-bbc0-4773c4c340fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.480904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2ffd17cb-b331-4274-bbc0-4773c4c340fd None None] MFA Rules not processed for user `852562a293b544c0848d8b4c0590c744`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:33.482439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2ffd17cb-b331-4274-bbc0-4773c4c340fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:33.552841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.555728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:33.634186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 972/1917] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:33.640477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd17cb-b331-4274-bbc0-4773c4c340fd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.660515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:33.706166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:33.743400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693a78-b1fe-4a1e-b24c-901f1e9e5e9a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:33.750483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:33.753025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.753312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.754043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] PATH_INFO: `/v3/projects/fc3a1004b69e408aafb50fc2d4964b6b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.759032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3a1004b69e408aafb50fc2d4964b6b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:33.761632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:33.773180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd17cb-b331-4274-bbc0-4773c4c340fd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:33.790016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:33.790708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.791064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.791447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.793840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:33.795921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:33.834181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 973/1918] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:33 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:33.837333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.841793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:33.860246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3a1004b69e408aafb50fc2d4964b6b', 'request_id': 'req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.871167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3a1004b69e408aafb50fc2d4964b6b', 'request_id': 'req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.883133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3a1004b69e408aafb50fc2d4964b6b', 'request_id': 'req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.897532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] The token cache is being invalidate because project fc3a1004b69e408aafb50fc2d4964b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:33.897866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.900112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e8c3ffc6-3ce7-4f73-89d3-4d80eab3be9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:33.905696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 946/1919] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:33 2022] DELETE /identity/v3/projects/fc3a1004b69e408aafb50fc2d4964b6b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:33.907235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5a927-571a-403d-8f24-9c2b88fbd72d None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:33.907538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5a927-571a-403d-8f24-9c2b88fbd72d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:33.907825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5a927-571a-403d-8f24-9c2b88fbd72d None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:33.909234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 947/1920] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:08:33.909968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5a927-571a-403d-8f24-9c2b88fbd72d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:33.911714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-75e5a927-571a-403d-8f24-9c2b88fbd72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:33.939885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba753b3-69d6-45c0-ae3e-98187deb97c0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.001987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5a927-571a-403d-8f24-9c2b88fbd72d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.006948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2c88-e77d-44cd-917f-4b34cf3c71af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.007662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2c88-e77d-44cd-917f-4b34cf3c71af admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.007949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2c88-e77d-44cd-917f-4b34cf3c71af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.008224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2c88-e77d-44cd-917f-4b34cf3c71af admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.008927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2c88-e77d-44cd-917f-4b34cf3c71af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.012151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2c88-e77d-44cd-917f-4b34cf3c71af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.015768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.016873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.017326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.017797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] PATH_INFO: `/v3/users/da3b04f9543f44f8bbb6bb06e68efc22` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.019169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3b04f9543f44f8bbb6bb06e68efc22)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.021259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.035361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 948/1921] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:33 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:34.036566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0ed1-e295-4fe5-bdff-0a7af547a5a2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.036855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0ed1-e295-4fe5-bdff-0a7af547a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.037139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c0ed1-e295-4fe5-bdff-0a7af547a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.060953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fb5c0ed1-e295-4fe5-bdff-0a7af547a5a2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:34.062365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fb5c0ed1-e295-4fe5-bdff-0a7af547a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.076513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:34.087253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3b04f9543f44f8bbb6bb06e68efc22'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.093564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 949/1922] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:34.101018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd0ab-d2d0-4fab-95d4-241aa1343feb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.101308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd0ab-d2d0-4fab-95d4-241aa1343feb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.101626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fd0ab-d2d0-4fab-95d4-241aa1343feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.106567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3b04f9543f44f8bbb6bb06e68efc22'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.107534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3b04f9543f44f8bbb6bb06e68efc22'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.121994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7a6fd0ab-d2d0-4fab-95d4-241aa1343feb None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:34.123220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7a6fd0ab-d2d0-4fab-95d4-241aa1343feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.124933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3b04f9543f44f8bbb6bb06e68efc22'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.126290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3b04f9543f44f8bbb6bb06e68efc22'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.143867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 974/1923] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:33 2022] DELETE /identity/v3/users/da3b04f9543f44f8bbb6bb06e68efc22 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:34.147245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.147245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.195257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:34.230895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 950/1924] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:34.245405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168dc2c-bbd1-449c-a752-fb4bb11c5ac3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.245710 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168dc2c-bbd1-449c-a752-fb4bb11c5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.246024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168dc2c-bbd1-449c-a752-fb4bb11c5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.259712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f632ec-c9d1-4ece-b5e6-052c2e1947b6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.268552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f99d5-3d88-4d71-9b5c-09dff8f689f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.269518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f99d5-3d88-4d71-9b5c-09dff8f689f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.269880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f99d5-3d88-4d71-9b5c-09dff8f689f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.270234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f99d5-3d88-4d71-9b5c-09dff8f689f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.271171 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f99d5-3d88-4d71-9b5c-09dff8f689f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.273246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f99d5-3d88-4d71-9b5c-09dff8f689f0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.282186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d168dc2c-bbd1-449c-a752-fb4bb11c5ac3 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:34.283113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d168dc2c-bbd1-449c-a752-fb4bb11c5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.293149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 975/1925] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:34.294745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd2dd-8822-499d-8ca1-a70aa1ad3959 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.295110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd2dd-8822-499d-8ca1-a70aa1ad3959 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.295507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bd2dd-8822-499d-8ca1-a70aa1ad3959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.299139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 951/1926] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:34.300057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168dc2c-bbd1-449c-a752-fb4bb11c5ac3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.317281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168dc2c-bbd1-449c-a752-fb4bb11c5ac3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.324351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.325083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.325391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.325717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.326651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.327439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-235bd2dd-8822-499d-8ca1-a70aa1ad3959 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:34.328572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.328742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-235bd2dd-8822-499d-8ca1-a70aa1ad3959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.339436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 976/1927] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:34.340866 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bd2dd-8822-499d-8ca1-a70aa1ad3959 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.349521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 952/1928] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:34.359493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.370711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bd2dd-8822-499d-8ca1-a70aa1ad3959 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.378216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02e624-c7c7-4593-b0b7-76c537700397 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.381930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.382693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.382977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.383254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.386565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:34.386882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.388505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.399295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.400196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.400486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.400862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] PATH_INFO: `/v3/projects/a578e50a78354a0387ff1f3809980379/users/291bd973f2d945da956d354a2f7071d0/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.402394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 977/1929] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:34.403167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.405020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.432458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a578e50a78354a0387ff1f3809980379, user_id=291bd973f2d945da956d354a2f7071d0, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.435630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.470348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 953/1930] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:34 2022] PUT /identity/v3/projects/a578e50a78354a0387ff1f3809980379/users/291bd973f2d945da956d354a2f7071d0/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:34.471279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.485188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc586dbf-90ef-4da3-9a46-9a9414ef4e1b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.561324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881038f-9d7e-44cb-a26e-42735fa331cf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.564825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:34.566111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.566779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.567324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.567608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.568330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.570285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.571840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a69a9-5dea-4bc1-9e40-b9472d693632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.573490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a69a9-5dea-4bc1-9e40-b9472d693632 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.574048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a69a9-5dea-4bc1-9e40-b9472d693632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.574343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a69a9-5dea-4bc1-9e40-b9472d693632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.584615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a69a9-5dea-4bc1-9e40-b9472d693632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.586172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a69a9-5dea-4bc1-9e40-b9472d693632 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.599979 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 978/1932] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:34.600132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 954/1932] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/projects => generated 409 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:34.600132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.600330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.600330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.600330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.600510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.633727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] MFA Rules not processed for user `291bd973f2d945da956d354a2f7071d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:34.635858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.693251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba23ef-c6ca-4b0c-a8d6-da489ca2ed86 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.699927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.700585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.700876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.701158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.711708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.713482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.717383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 979/1933] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:34.718065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.721048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.738248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 955/1934] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:34.738868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.764505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:34.812976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e7c98-4587-44c6-a61f-e8d8667a4df8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.820271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.821468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.821903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.822192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] PATH_INFO: `/v3/users/0217a62228cb44b6888bb79821d9ca1c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.824425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0217a62228cb44b6888bb79821d9ca1c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.826634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.836073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713067c3-4055-4267-93e4-9fe8925f4545 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.842268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.842948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.843248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.843508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.844495 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.846477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.876774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 956/1935] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/users => generated 305 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:34.877774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.894693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb382eb-3b74-4094-b050-fc48e06bc01c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:34.901855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:34.902643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:34.902990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:34.903338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:34.904039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:34.906043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:34.906324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0217a62228cb44b6888bb79821d9ca1c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.915463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0217a62228cb44b6888bb79821d9ca1c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.917654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0217a62228cb44b6888bb79821d9ca1c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.936774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0217a62228cb44b6888bb79821d9ca1c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.937888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0217a62228cb44b6888bb79821d9ca1c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:34.945083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 957/1936] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:34 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:34.945083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.945083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:34.956127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:34.964655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 980/1937] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:34 2022] DELETE /identity/v3/users/0217a62228cb44b6888bb79821d9ca1c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:34.966728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:34.969383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.031364 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d25054-e601-4304-8983-9856d5c799a2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.062523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89958428-e17d-41fe-836a-e229881abd8a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.066236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a65f-97f0-46fa-bb15-6f528ea489a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.067140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a65f-97f0-46fa-bb15-6f528ea489a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.067422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a65f-97f0-46fa-bb15-6f528ea489a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.067693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a65f-97f0-46fa-bb15-6f528ea489a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.069554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3686a65f-97f0-46fa-bb15-6f528ea489a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.096619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.097308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.097667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.097935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.098663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.100272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.111151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 958/1938] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:35.112125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.115203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.128035 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51351a69-d42d-4717-bb92-7971295b6821 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.132696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.133390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.133713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.133989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.134774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.137154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.145763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a65f-97f0-46fa-bb15-6f528ea489a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.147592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a65f-97f0-46fa-bb15-6f528ea489a8 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.158791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 981/1939] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:35.160471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8301b1-f288-415a-b8af-c4d1f13b25f6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.160758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8301b1-f288-415a-b8af-c4d1f13b25f6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.161034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8301b1-f288-415a-b8af-c4d1f13b25f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.164721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 959/1940] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:35 2022] POST /identity/v3/users => generated 300 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:35.164721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.164721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.176553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d89a4a-3cb8-4c60-ab4e-71651ca613fa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.180879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ad8301b1-f288-415a-b8af-c4d1f13b25f6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:35.182817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ad8301b1-f288-415a-b8af-c4d1f13b25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.187730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.188609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.188897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.189179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] PATH_INFO: `/v3/projects/b3ff78df390b47d787df90c1a36d3466` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.190396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ff78df390b47d787df90c1a36d3466)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.192765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.194618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 982/1941] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:35.195508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8301b1-f288-415a-b8af-c4d1f13b25f6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.203998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:35.207992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8301b1-f288-415a-b8af-c4d1f13b25f6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.213557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.214502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.214848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.215205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.216182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.218679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.231754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 983/1942] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:35.232759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.244060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761d916-f09f-471e-8748-e116919c5269 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.256039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ff78df390b47d787df90c1a36d3466', 'request_id': 'req-e6362b55-00d8-4d04-acb1-675314cdc11a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:35.269558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ff78df390b47d787df90c1a36d3466', 'request_id': 'req-e6362b55-00d8-4d04-acb1-675314cdc11a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:35.278940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ff78df390b47d787df90c1a36d3466', 'request_id': 'req-e6362b55-00d8-4d04-acb1-675314cdc11a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:35.293077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] The token cache is being invalidate because project b3ff78df390b47d787df90c1a36d3466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:35.293380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:35.294067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:35.300227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 960/1943] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:35 2022] DELETE /identity/v3/projects/b3ff78df390b47d787df90c1a36d3466 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:35.300227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.300227 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.318055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.318738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.319034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.319370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.320061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.321827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.334191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 984/1944] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:35.335809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.338374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.352381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fc88a-c6c6-4292-95a2-02b55e8728ad admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.357251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f318b78-8339-40c7-975b-8f58f6f35b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.358178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f318b78-8339-40c7-975b-8f58f6f35b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.358453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f318b78-8339-40c7-975b-8f58f6f35b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.358749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f318b78-8339-40c7-975b-8f58f6f35b76 admin admin] PATH_INFO: `/v3/projects/b315cd8612444f44be26384e0e24b49a/users/609113819a0a42249e31d3c931d1cc9f/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.370023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362b55-00d8-4d04-acb1-675314cdc11a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.374514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f318b78-8339-40c7-975b-8f58f6f35b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b315cd8612444f44be26384e0e24b49a, user_id=609113819a0a42249e31d3c931d1cc9f, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.376700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.377254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f318b78-8339-40c7-975b-8f58f6f35b76 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.377728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.378177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.378589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.381172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.392011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 985/1945] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:35 2022] PUT /identity/v3/projects/b315cd8612444f44be26384e0e24b49a/users/609113819a0a42249e31d3c931d1cc9f/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:35.393507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df595c12-f65b-4ad3-b62b-9791ecdf75ab None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.393795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df595c12-f65b-4ad3-b62b-9791ecdf75ab None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.394066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df595c12-f65b-4ad3-b62b-9791ecdf75ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.395906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.397335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.407304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:35.421663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-df595c12-f65b-4ad3-b62b-9791ecdf75ab None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:35.422231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 961/1946] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:35.422930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.423040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df595c12-f65b-4ad3-b62b-9791ecdf75ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.424321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.438745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae63663-7545-462c-94d7-d697df5a7bbb service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.493892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 986/1947] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:35.495941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db79a72-bd68-4a4e-a908-b89133387759 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.496294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db79a72-bd68-4a4e-a908-b89133387759 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.496559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db79a72-bd68-4a4e-a908-b89133387759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.543502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8db79a72-bd68-4a4e-a908-b89133387759 None None] MFA Rules not processed for user `609113819a0a42249e31d3c931d1cc9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:35.544961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8db79a72-bd68-4a4e-a908-b89133387759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.583337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db58341-393c-4f34-97e3-19e71764ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.584894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58341-393c-4f34-97e3-19e71764ecca admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.587050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58341-393c-4f34-97e3-19e71764ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.597193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db58341-393c-4f34-97e3-19e71764ecca admin admin] PATH_INFO: `/v3/projects/ace2170f8235401a95cc4d92020bdc09/users/03d7df6d0bde434ab29246030a2224fa/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.637550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db58341-393c-4f34-97e3-19e71764ecca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace2170f8235401a95cc4d92020bdc09, user_id=03d7df6d0bde434ab29246030a2224fa, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.644876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db58341-393c-4f34-97e3-19e71764ecca admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.681307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 962/1948] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:35 2022] PUT /identity/v3/projects/ace2170f8235401a95cc4d92020bdc09/users/03d7df6d0bde434ab29246030a2224fa/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:35.682863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6067-e3b7-4f45-84fc-fcfaf3f2fb32 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.683181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6067-e3b7-4f45-84fc-fcfaf3f2fb32 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.683435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da6067-e3b7-4f45-84fc-fcfaf3f2fb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.690141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 987/1949] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:35.690993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db79a72-bd68-4a4e-a908-b89133387759 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.710468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db79a72-bd68-4a4e-a908-b89133387759 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.717908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a8da6067-e3b7-4f45-84fc-fcfaf3f2fb32 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:35.719304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a8da6067-e3b7-4f45-84fc-fcfaf3f2fb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:35.744646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:35.812401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.813088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.813394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.813681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.814625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.819796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.830302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 963/1950] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:35.831302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da6067-e3b7-4f45-84fc-fcfaf3f2fb32 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.843697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 988/1951] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:35.845138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.845883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da6067-e3b7-4f45-84fc-fcfaf3f2fb32 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.851728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.852534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.852823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.853104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.854064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.856838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.861929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5792307-4b26-45d7-970e-f7e33ae17bfa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.868376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.870347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.871110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.871570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.873058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:35.874036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.877538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:35.900018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 989/1952] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:35.900018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.905449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 964/1953] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:35 2022] POST /identity/v3/projects => generated 407 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:35.906944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:35.919366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36615503-d2fa-4aab-be98-b227f114fec3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:35.936630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:35.990683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:35.991794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:35.992066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:35.992351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] PATH_INFO: `/v3/projects/ace2170f8235401a95cc4d92020bdc09/users/03d7df6d0bde434ab29246030a2224fa/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:35.995640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace2170f8235401a95cc4d92020bdc09, user_id=03d7df6d0bde434ab29246030a2224fa, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:35.998781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.000811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f93d38-3559-439c-af3d-6020726b854a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.007186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb44e8-6c0b-4c66-be0e-a2352dfa689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.010477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb44e8-6c0b-4c66-be0e-a2352dfa689d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.011248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb44e8-6c0b-4c66-be0e-a2352dfa689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.011760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb44e8-6c0b-4c66-be0e-a2352dfa689d admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.012759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb44e8-6c0b-4c66-be0e-a2352dfa689d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.015041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb44e8-6c0b-4c66-be0e-a2352dfa689d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.022351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 990/1954] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:35 2022] PUT /identity/v3/projects/ace2170f8235401a95cc4d92020bdc09/users/03d7df6d0bde434ab29246030a2224fa/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:36.024335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.085311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 965/1955] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:35 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:36.089308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13c43-fb1e-4bbb-8c6c-edb1aa2fab14 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.089824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13c43-fb1e-4bbb-8c6c-edb1aa2fab14 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.090054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd13c43-fb1e-4bbb-8c6c-edb1aa2fab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.143748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9dd13c43-fb1e-4bbb-8c6c-edb1aa2fab14 None None] MFA Rules not processed for user `03d7df6d0bde434ab29246030a2224fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:36.144985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9dd13c43-fb1e-4bbb-8c6c-edb1aa2fab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.204000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabad83f-b4cd-4361-872c-ef5f8bea4d75 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.265022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 966/1956] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:36.265022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd13c43-fb1e-4bbb-8c6c-edb1aa2fab14 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.285545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:36.323678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.324692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.324873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.325150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.325894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.327833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.354800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 991/1957] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:36 2022] POST /identity/v3/users => generated 310 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:36.356180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.359250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.372186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd13c43-fb1e-4bbb-8c6c-edb1aa2fab14 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.376786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.377522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.377803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.378077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.378770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.380685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.404442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 967/1958] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:36 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:36.404442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.404442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.417974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c13d5-052b-462c-9a41-55be20c9d088 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.420107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:36.423324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.424220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.424507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.424609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b342-097d-4fc2-ae64-1027d72d80d5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.424784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] PATH_INFO: `/v3/projects/ee7438a05a0e4840934d90146499dd85` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.426187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7438a05a0e4840934d90146499dd85)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.428185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.429433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.430209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.430803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.431096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.442527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.443978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.454333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 992/1959] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:36.455130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.466479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172810a3-9e27-4b6f-ab4d-b28ac121dbb5 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.471484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.472142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.472430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.472706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.473467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.475056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.483410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7438a05a0e4840934d90146499dd85', 'request_id': 'req-ef421e75-3455-4669-bde4-14c08956e5b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.488776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 993/1960] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:36.490021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.493598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7438a05a0e4840934d90146499dd85', 'request_id': 'req-ef421e75-3455-4669-bde4-14c08956e5b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.500701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7438a05a0e4840934d90146499dd85', 'request_id': 'req-ef421e75-3455-4669-bde4-14c08956e5b0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.507815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cc5c1-655c-4e22-b5d7-0693f6bfe69e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.519245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] The token cache is being invalidate because project ee7438a05a0e4840934d90146499dd85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:36.519534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.520215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.521841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 968/1961] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:36 2022] DELETE /identity/v3/projects/ee7438a05a0e4840934d90146499dd85 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:36.522595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.523937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.585634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.586230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.586577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.586865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.587595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.590157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.592578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef421e75-3455-4669-bde4-14c08956e5b0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.600388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.601700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 994/1962] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:36.602399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.602892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.603353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] PATH_INFO: `/v3/projects/329d0010500640c9be9191a6ba7993d4/users/1afc782bcc144ea39fa9fd97b349e645/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.605718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.607385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.621099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8398-023e-4078-8b58-87567863fffe admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.625814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.626785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.627135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.627554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] PATH_INFO: `/v3/users/a792abd184874d40bc31c79e2ee6c17c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.628773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a792abd184874d40bc31c79e2ee6c17c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.630051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=329d0010500640c9be9191a6ba7993d4, user_id=1afc782bcc144ea39fa9fd97b349e645, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.630711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.633881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.651833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 969/1963] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:36 2022] PUT /identity/v3/projects/329d0010500640c9be9191a6ba7993d4/users/1afc782bcc144ea39fa9fd97b349e645/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:36.652647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.655593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.674243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:36.705867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a792abd184874d40bc31c79e2ee6c17c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.716257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a792abd184874d40bc31c79e2ee6c17c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.717292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a792abd184874d40bc31c79e2ee6c17c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.738813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a792abd184874d40bc31c79e2ee6c17c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.740455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a792abd184874d40bc31c79e2ee6c17c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:36.762526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 995/1964] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:36 2022] DELETE /identity/v3/users/a792abd184874d40bc31c79e2ee6c17c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:36.762526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.762526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.770276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32789e-0189-4f0c-b92a-d070717d27fb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.832333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:36.848558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.849461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.849800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.850220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.851029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.852979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.865581 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5b6e6-1811-4bc3-adec-73cf3b0ad83b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.872028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.873285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.874184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.874493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.875655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.877788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.881585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 970/1965] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:36.886768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.890746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:36.895226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 996/1966] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:36.900052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:36.919100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a740-6d6d-427d-8b80-dc12c1e8f5de admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.922189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5626c-fa58-4ed7-b211-afb0d65c4dfb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:36.928932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e166a1-76b4-40f4-bfde-080417ab1af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.930355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75e89-5535-4b13-b94f-8b736ad21d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:36.931181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e166a1-76b4-40f4-bfde-080417ab1af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.931371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75e89-5535-4b13-b94f-8b736ad21d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.932108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75e89-5535-4b13-b94f-8b736ad21d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.932417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e166a1-76b4-40f4-bfde-080417ab1af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.932561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75e89-5535-4b13-b94f-8b736ad21d3a admin admin] PATH_INFO: `/v3/projects/329d0010500640c9be9191a6ba7993d4/users/1afc782bcc144ea39fa9fd97b349e645/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.932746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e166a1-76b4-40f4-bfde-080417ab1af4 admin admin] PATH_INFO: `/v3/projects/aaa497fb4c6d4f1a97d7fd2884b39919/users/eb8c942c7ba54955bb64d3235845500d/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.935683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75e89-5535-4b13-b94f-8b736ad21d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=329d0010500640c9be9191a6ba7993d4, user_id=1afc782bcc144ea39fa9fd97b349e645, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.941541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75e89-5535-4b13-b94f-8b736ad21d3a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.963968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e166a1-76b4-40f4-bfde-080417ab1af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa497fb4c6d4f1a97d7fd2884b39919, user_id=eb8c942c7ba54955bb64d3235845500d, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:36.973589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 997/1967] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:36 2022] PUT /identity/v3/projects/329d0010500640c9be9191a6ba7993d4/users/1afc782bcc144ea39fa9fd97b349e645/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:36.973709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e166a1-76b4-40f4-bfde-080417ab1af4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:36.977008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:36.977643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:36.978195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:36.992154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 971/1968] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:36 2022] PUT /identity/v3/projects/aaa497fb4c6d4f1a97d7fd2884b39919/users/eb8c942c7ba54955bb64d3235845500d/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:37.004333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a681ee-45a2-42f6-a17f-e6b8ad70ef23 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.004685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a681ee-45a2-42f6-a17f-e6b8ad70ef23 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.005081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a681ee-45a2-42f6-a17f-e6b8ad70ef23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.020181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] MFA Rules not processed for user `1afc782bcc144ea39fa9fd97b349e645`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:37.022026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.039305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-76a681ee-45a2-42f6-a17f-e6b8ad70ef23 None None] MFA Rules not processed for user `eb8c942c7ba54955bb64d3235845500d`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:37.040713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-76a681ee-45a2-42f6-a17f-e6b8ad70ef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.144428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 998/1969] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:36 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:37.153193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 972/1970] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:37.157657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.158332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a681ee-45a2-42f6-a17f-e6b8ad70ef23 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.160596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.245740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:37.306603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42840a54-a6e1-46b3-b912-0492b5bbca72 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.309677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a681ee-45a2-42f6-a17f-e6b8ad70ef23 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.311843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.312787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.313237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.313553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.315762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.316454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.316735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.317284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.319129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.321460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.327211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.328923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.341721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 999/1971] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:37 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:37.343271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.345697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.359458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756602c8-85bb-4b8b-924b-4634a8ae284d service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.371298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.372715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.373191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.373676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.378971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 973/1972] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:37 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:37.378971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.381468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.381857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.475627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f410ba-3066-4a1b-b507-dff127feaf09 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.497737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.498643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.498929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.502733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] PATH_INFO: `/v3/projects/4cb303f9a05042ff91d0ed8cdc7d7706` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.506165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb303f9a05042ff91d0ed8cdc7d7706)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.513078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.530679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.532038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.541870 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:37.560154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1000/1973] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:37.561209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.581587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a02ef1-8faf-49b8-9bf0-2c82fb7f5bb6 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.602214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb303f9a05042ff91d0ed8cdc7d7706', 'request_id': 'req-7e507726-c268-4907-a068-12c0c2ca89ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:37.616146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb303f9a05042ff91d0ed8cdc7d7706', 'request_id': 'req-7e507726-c268-4907-a068-12c0c2ca89ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:37.628768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb303f9a05042ff91d0ed8cdc7d7706', 'request_id': 'req-7e507726-c268-4907-a068-12c0c2ca89ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:37.645041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] The token cache is being invalidate because project 4cb303f9a05042ff91d0ed8cdc7d7706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:37.645333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:37.646597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7e507726-c268-4907-a068-12c0c2ca89ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:37.652887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 974/1974] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:37 2022] DELETE /identity/v3/projects/4cb303f9a05042ff91d0ed8cdc7d7706 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:37.654476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.654884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.655234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.678220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:37.679797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.680939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48060443-7441-418e-9682-9e6eb6beec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.681738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060443-7441-418e-9682-9e6eb6beec2c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.682156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060443-7441-418e-9682-9e6eb6beec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.682602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060443-7441-418e-9682-9e6eb6beec2c admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.683501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48060443-7441-418e-9682-9e6eb6beec2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.685586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48060443-7441-418e-9682-9e6eb6beec2c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.704718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 975/1975] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:37.705742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.707155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.712326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1001/1976] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:37 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:37.712326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082df797-3326-45f0-8ea6-546775d5feef None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.712326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082df797-3326-45f0-8ea6-546775d5feef None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.712326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082df797-3326-45f0-8ea6-546775d5feef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.736855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-082df797-3326-45f0-8ea6-546775d5feef None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:37.738873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-082df797-3326-45f0-8ea6-546775d5feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.748988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:37.752429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1002/1977] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:37.753704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082df797-3326-45f0-8ea6-546775d5feef None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.763028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-082df797-3326-45f0-8ea6-546775d5feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.783999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082df797-3326-45f0-8ea6-546775d5feef None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.789226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.789932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.790211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.790491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.791763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.793779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.803549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e5296-9b3a-45c2-827a-f4a04a97725c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.804816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1003/1978] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:37.805884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.809379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.810289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.810639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.810996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.813087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:37.818276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d4fb-6c42-4039-98f3-12077a0b96e5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.824425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.825121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.825459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.825733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.826474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:37.826779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.828391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.843368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1004/1979] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:37.847917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.859813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fc31a-eb8e-4aac-9100-bf416e9e1368 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.864767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.865519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.865951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.866220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.866999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.868659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.882176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1005/1980] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:37.883015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.895028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aeb081-c142-4324-b8f3-17b3cb558f8e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.899904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.901115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.901667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.901963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.902714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.902916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.904628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.904932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:37.918000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 976/1981] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:37.918907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.935518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8285ea-460e-46d2-aa3e-1f5af37cfe26 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:37.942579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1006/1982] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:37 2022] POST /identity/v3/projects => generated 355 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:37.947023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:37.951311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79a32a-8268-4924-90eb-b7566b9581ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:37.952506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a32a-8268-4924-90eb-b7566b9581ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:37.952941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a32a-8268-4924-90eb-b7566b9581ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:37.953323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79a32a-8268-4924-90eb-b7566b9581ea admin admin] PATH_INFO: `/v3/projects/193ebf40c3e94223874675b152f572ea/users/1990bfbdad05460cb9559882bcd0a65c/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:37.984745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79a32a-8268-4924-90eb-b7566b9581ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=193ebf40c3e94223874675b152f572ea, user_id=1990bfbdad05460cb9559882bcd0a65c, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:37.987759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79a32a-8268-4924-90eb-b7566b9581ea admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.016084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 977/1983] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:37 2022] PUT /identity/v3/projects/193ebf40c3e94223874675b152f572ea/users/1990bfbdad05460cb9559882bcd0a65c/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:38.035539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b45c-fc2e-4ee5-8915-6c30016e3b1b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.035834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b45c-fc2e-4ee5-8915-6c30016e3b1b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.036110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b45c-fc2e-4ee5-8915-6c30016e3b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.084487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d3dac-b0a9-4517-9c3b-090291d25cfd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.090680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1793b45c-fc2e-4ee5-8915-6c30016e3b1b None None] MFA Rules not processed for user `1990bfbdad05460cb9559882bcd0a65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:38.091928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1793b45c-fc2e-4ee5-8915-6c30016e3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:38.140746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:38.201013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 978/1984] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:38.205357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.206130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.206752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.207461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b45c-fc2e-4ee5-8915-6c30016e3b1b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.207657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.208390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.210565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.230399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b45c-fc2e-4ee5-8915-6c30016e3b1b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.240576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.240576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.240576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.240576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.246431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.246431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.255330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1007/1985] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:37 2022] POST /identity/v3/users => generated 278 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:38.257281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.283938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3b64c-c330-4fa5-8651-a5a6d04afb7e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.293925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.294742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.295030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.295310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.296058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.303761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 979/1986] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:38 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:38.303977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.304075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.329800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1008/1987] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:38.329800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.349155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937bcae-de48-48a6-8904-32c01597695b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.356269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:38.456813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b9f43-6fad-469d-a046-80d8a947f7f8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.459784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33918904-5bcc-4703-a509-13600133368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.460501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918904-5bcc-4703-a509-13600133368a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.460921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918904-5bcc-4703-a509-13600133368a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.461267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33918904-5bcc-4703-a509-13600133368a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.462486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33918904-5bcc-4703-a509-13600133368a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.465154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33918904-5bcc-4703-a509-13600133368a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.468221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.470794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.471112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.471464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.472361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.474423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.483710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1009/1988] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:38.499590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33918904-5bcc-4703-a509-13600133368a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.522881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33918904-5bcc-4703-a509-13600133368a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.528917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 980/1989] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:38 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:08:38.529383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae951b1-7d83-4d28-9a2c-5e9fb78eee19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.530241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae951b1-7d83-4d28-9a2c-5e9fb78eee19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.530639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae951b1-7d83-4d28-9a2c-5e9fb78eee19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.530978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae951b1-7d83-4d28-9a2c-5e9fb78eee19 admin admin] PATH_INFO: `/v3/projects/449a1305deb342cf82673821b10fb9d1/users/c8e81314780b46c8bdf5a577ca957827/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.535576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.547805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b312e1-658f-4f71-ac07-ece326d066fd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.554361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.555060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.555585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.556021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.557606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.561394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.563544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae951b1-7d83-4d28-9a2c-5e9fb78eee19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449a1305deb342cf82673821b10fb9d1, user_id=c8e81314780b46c8bdf5a577ca957827, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.567297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae951b1-7d83-4d28-9a2c-5e9fb78eee19 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.575827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 981/1990] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:38.580369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.593384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1010/1991] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:38 2022] PUT /identity/v3/projects/449a1305deb342cf82673821b10fb9d1/users/c8e81314780b46c8bdf5a577ca957827/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:38.595547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bc739-2e18-43f9-bd90-8b5586137198 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.601313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017d046-bae8-4593-9bc3-a7c383d7007f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.601819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017d046-bae8-4593-9bc3-a7c383d7007f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.602113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017d046-bae8-4593-9bc3-a7c383d7007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.639370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9017d046-bae8-4593-9bc3-a7c383d7007f None None] MFA Rules not processed for user `c8e81314780b46c8bdf5a577ca957827`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:38.640806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9017d046-bae8-4593-9bc3-a7c383d7007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:38.662278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.664057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.664488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.665066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] PATH_INFO: `/v3/projects/345a38ce9c1c41bda753142b3e2f3917/users/4809ced5da4b4391b5fe021c9b45fe2b/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.698734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=345a38ce9c1c41bda753142b3e2f3917, user_id=4809ced5da4b4391b5fe021c9b45fe2b, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.702951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.722662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 982/1992] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:38 2022] PUT /identity/v3/projects/345a38ce9c1c41bda753142b3e2f3917/users/4809ced5da4b4391b5fe021c9b45fe2b/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:38.723839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1011/1993] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:38.726605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.728511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017d046-bae8-4593-9bc3-a7c383d7007f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.739013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017d046-bae8-4593-9bc3-a7c383d7007f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.748446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:38.801278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1629c-8383-4346-b4a3-daf09a898192 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.806376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.807042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.807697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.807813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.807951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.808306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.808409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.808754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.809127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.809621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.810771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.811760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.822676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 983/1994] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:38.826711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.839149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54e0d8-d1a8-42e2-b34e-a635078ab580 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:38.843967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7413e1-9c86-49ff-97a3-af2172673f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:38.844751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1012/1995] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:38 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:08:38.844962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7413e1-9c86-49ff-97a3-af2172673f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.845121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7413e1-9c86-49ff-97a3-af2172673f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.845423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7413e1-9c86-49ff-97a3-af2172673f35 admin admin] PATH_INFO: `/v3/projects/345a38ce9c1c41bda753142b3e2f3917/users/4809ced5da4b4391b5fe021c9b45fe2b/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.847932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7413e1-9c86-49ff-97a3-af2172673f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=345a38ce9c1c41bda753142b3e2f3917, user_id=4809ced5da4b4391b5fe021c9b45fe2b, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:38.849543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:38.850722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7413e1-9c86-49ff-97a3-af2172673f35 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:38.864000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 984/1996] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:38 2022] PUT /identity/v3/projects/345a38ce9c1c41bda753142b3e2f3917/users/4809ced5da4b4391b5fe021c9b45fe2b/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:38.876308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:38.876867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:38.877194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:38.891896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:38.932290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] MFA Rules not processed for user `4809ced5da4b4391b5fe021c9b45fe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:38.933817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:38.956289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f118f-40dc-417b-a17d-5638cbf09638 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.022107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 985/1997] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:39.032603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.033299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.033614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.033898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.034588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.036542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.038770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:39.040399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:39.077956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1013/1998] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:38 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:39.083426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:39.098230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fabe5-93e0-489e-8a63-363bce1cc51f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.106697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.107986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.108363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.109233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.110588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.113429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.125098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf85f-37de-49b5-8b13-7b584b563df2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.126395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1014/1999] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:39.130116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.130603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:39.130709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.130927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.131208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.133305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:39.141248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f54c-ac01-478c-8de8-0ccb1c3c658d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.146093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.146972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.147261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.147551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] PATH_INFO: `/v3/projects/fc52c7c5b01d46a68060115f521ab22f/users/879cc38406564735921997dbe6857fb6/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.166617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc52c7c5b01d46a68060115f521ab22f, user_id=879cc38406564735921997dbe6857fb6, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.169397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.180467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:39.192033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1015/2000] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:39 2022] PUT /identity/v3/projects/fc52c7c5b01d46a68060115f521ab22f/users/879cc38406564735921997dbe6857fb6/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:39.192912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:39.214918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.216359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.226131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 986/2001] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:39.268424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed62a-534d-43f5-a905-85930bf31dc3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.273474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab3a60-e7a9-45b5-a827-f097e6095386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.274484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3a60-e7a9-45b5-a827-f097e6095386 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.274484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3a60-e7a9-45b5-a827-f097e6095386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.274761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab3a60-e7a9-45b5-a827-f097e6095386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.276118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3a60-e7a9-45b5-a827-f097e6095386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.278257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab3a60-e7a9-45b5-a827-f097e6095386 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.289650 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1016/2002] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:39.294203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:39.313512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe259079-118e-4221-beb7-b8ec12f5dc1f service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.321084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.323146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.323491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.323764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] PATH_INFO: `/v3/projects/fc52c7c5b01d46a68060115f521ab22f/users/879cc38406564735921997dbe6857fb6/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.325822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc52c7c5b01d46a68060115f521ab22f, user_id=879cc38406564735921997dbe6857fb6, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.328458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.341822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 987/2003] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:39 2022] PUT /identity/v3/projects/fc52c7c5b01d46a68060115f521ab22f/users/879cc38406564735921997dbe6857fb6/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:39.353497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5cd5a-a921-4193-a6bd-4b766d68e3e3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.353787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5cd5a-a921-4193-a6bd-4b766d68e3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.354063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5cd5a-a921-4193-a6bd-4b766d68e3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.381023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-90a5cd5a-a921-4193-a6bd-4b766d68e3e3 None None] MFA Rules not processed for user `879cc38406564735921997dbe6857fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:39.382309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-90a5cd5a-a921-4193-a6bd-4b766d68e3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:39.468938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1017/2004] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:39.503309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:39.555366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:39.584757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f4656-f587-4aef-845d-fca85303880f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.592217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfde025-3da1-49ea-b265-4b47528f17eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.593104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfde025-3da1-49ea-b265-4b47528f17eb service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.593831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfde025-3da1-49ea-b265-4b47528f17eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.594212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfde025-3da1-49ea-b265-4b47528f17eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.607531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfde025-3da1-49ea-b265-4b47528f17eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.609109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfde025-3da1-49ea-b265-4b47528f17eb service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.620269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 988/2005] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:39 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:39.752831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5cd5a-a921-4193-a6bd-4b766d68e3e3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:39.767094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5cd5a-a921-4193-a6bd-4b766d68e3e3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:39.772419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0906f32-0864-4a09-965d-205cd3493b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:39.773152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0906f32-0864-4a09-965d-205cd3493b81 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:39.773741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0906f32-0864-4a09-965d-205cd3493b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:39.774056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0906f32-0864-4a09-965d-205cd3493b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:39.836548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0906f32-0864-4a09-965d-205cd3493b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:39.838408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0906f32-0864-4a09-965d-205cd3493b81 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:39.849516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1018/2006] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:39 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:40.268404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea531c8-c77b-4291-82fb-877a8cf47a82 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:40.268903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea531c8-c77b-4291-82fb-877a8cf47a82 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:40.269523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea531c8-c77b-4291-82fb-877a8cf47a82 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:40.270730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 989/2007] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:08:40.285054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730770f8-2a8d-4bcd-913b-0b05126a6fa0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:40.285054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730770f8-2a8d-4bcd-913b-0b05126a6fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:40.285231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730770f8-2a8d-4bcd-913b-0b05126a6fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:40.314448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-730770f8-2a8d-4bcd-913b-0b05126a6fa0 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:40.315717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-730770f8-2a8d-4bcd-913b-0b05126a6fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:40.352542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:40.434461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1019/2008] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:08:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:40.449675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea531c8-c77b-4291-82fb-877a8cf47a82 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:40.451608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ea531c8-c77b-4291-82fb-877a8cf47a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:40.470231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea531c8-c77b-4291-82fb-877a8cf47a82 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:40.480135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:40.481034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:40.481536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:40.481957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:40.492410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:40.494699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:40.507627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 990/2009] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:40.924557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730770f8-2a8d-4bcd-913b-0b05126a6fa0 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:40.935764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730770f8-2a8d-4bcd-913b-0b05126a6fa0 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:40.943890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:40.944580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:40.944923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:40.945261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:41.003107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:41.004559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:41.014430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1020/2010] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:41.927899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:41.943567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ceb01-6ce1-49cf-b052-e370d2bb577a service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:41.949851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:41.950527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:41.954682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:41.955032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:42.048716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:42.050313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:42.068876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 991/2011] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:42.134832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:42.145832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188a266-4818-4db9-bf72-a9c3631aea4b service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:42.151340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113e9d-d08f-47cf-ae01-3c2855b965cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:42.152497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113e9d-d08f-47cf-ae01-3c2855b965cf service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:42.152927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113e9d-d08f-47cf-ae01-3c2855b965cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:42.153403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113e9d-d08f-47cf-ae01-3c2855b965cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:42.156149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-42113e9d-d08f-47cf-ae01-3c2855b965cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:42.263789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113e9d-d08f-47cf-ae01-3c2855b965cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:42.265747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113e9d-d08f-47cf-ae01-3c2855b965cf service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:42.278662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1021/2012] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:46.206683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:46.208105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:46.297220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171b492-b428-4292-acfc-7101f154723e service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:46.303253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:46.304306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:46.304744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:46.305280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] PATH_INFO: `/v3/users/852562a293b544c0848d8b4c0590c744` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:46.307862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=852562a293b544c0848d8b4c0590c744)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:46.309918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:46.368193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852562a293b544c0848d8b4c0590c744'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.376650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852562a293b544c0848d8b4c0590c744'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.377270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852562a293b544c0848d8b4c0590c744'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.377906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852562a293b544c0848d8b4c0590c744'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.383598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:46.388562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852562a293b544c0848d8b4c0590c744'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.413912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 992/2013] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:46 2022] DELETE /identity/v3/users/852562a293b544c0848d8b4c0590c744 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:46.419470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:46.420060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:46.420060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:46.443365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:46.445004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:46.506307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:46.532998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1022/2014] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:46.549442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:46.551075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:46.633557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cc6d6e-bbd9-4467-8c72-8195d00eed8e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:46.639939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be917a-7ec2-43bf-b454-adc5c2847564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:46.640875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be917a-7ec2-43bf-b454-adc5c2847564 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:46.641007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be917a-7ec2-43bf-b454-adc5c2847564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:46.641289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be917a-7ec2-43bf-b454-adc5c2847564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:46.656414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be917a-7ec2-43bf-b454-adc5c2847564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:46.658085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be917a-7ec2-43bf-b454-adc5c2847564 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:46.694626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 993/2015] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:46.774748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:46.778009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:46.797078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61507e95-21e6-433c-a0d6-e4a19ae1ef28 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:46.802731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:46.804407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:46.804407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:46.804702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] PATH_INFO: `/v3/users/609113819a0a42249e31d3c931d1cc9f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:46.813733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609113819a0a42249e31d3c931d1cc9f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:46.816050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:46.924401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609113819a0a42249e31d3c931d1cc9f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.940267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609113819a0a42249e31d3c931d1cc9f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.941327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609113819a0a42249e31d3c931d1cc9f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.963494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609113819a0a42249e31d3c931d1cc9f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:46.964270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609113819a0a42249e31d3c931d1cc9f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.005104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1023/2016] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:46 2022] DELETE /identity/v3/users/609113819a0a42249e31d3c931d1cc9f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:47.006745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.007242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.007594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.028961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:47.031067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:47.105789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 994/2017] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:47.122501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:47.125088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:47.201178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098663a-6d42-446e-8161-3e673d32bd90 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:47.206041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:47.206884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.207175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.207453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.218155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:47.219621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:47.233842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1024/2018] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:47.281537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:47.283575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:47.296827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e2dd-972d-44ac-8678-a668480fe443 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:47.302242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:47.303492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.318363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.318803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] PATH_INFO: `/v3/projects/269343703f0243d2a6c06b6bd42d3e1a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.323039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269343703f0243d2a6c06b6bd42d3e1a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:47.325162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:47.383456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269343703f0243d2a6c06b6bd42d3e1a', 'request_id': 'req-d7a2756c-f92c-499c-8049-b96780a683f2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.394583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269343703f0243d2a6c06b6bd42d3e1a', 'request_id': 'req-d7a2756c-f92c-499c-8049-b96780a683f2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.412349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269343703f0243d2a6c06b6bd42d3e1a', 'request_id': 'req-d7a2756c-f92c-499c-8049-b96780a683f2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.450131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] The token cache is being invalidate because project 269343703f0243d2a6c06b6bd42d3e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:47.450131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.450836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.452673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 995/2019] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:47 2022] DELETE /identity/v3/projects/269343703f0243d2a6c06b6bd42d3e1a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:47.458019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:47.459538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:47.463654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:47.467554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5bc05-73ca-4358-b5c5-4e32d8e98956 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:47.468872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:47.547592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:47.548970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.549368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.549762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] PATH_INFO: `/v3/users/291bd973f2d945da956d354a2f7071d0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.551223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=291bd973f2d945da956d354a2f7071d0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:47.551372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2756c-f92c-499c-8049-b96780a683f2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:47.553321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:47.556338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:47.558899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:47.560049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.560478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.560759 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] PATH_INFO: `/v3/users/eb8c942c7ba54955bb64d3235845500d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.562027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8c942c7ba54955bb64d3235845500d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:47.563975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:47.625309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291bd973f2d945da956d354a2f7071d0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.628752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8c942c7ba54955bb64d3235845500d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.633564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291bd973f2d945da956d354a2f7071d0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.634967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291bd973f2d945da956d354a2f7071d0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.637833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8c942c7ba54955bb64d3235845500d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.638554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8c942c7ba54955bb64d3235845500d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.639336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8c942c7ba54955bb64d3235845500d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.647158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dae985ac-3798-4177-9204-8c8da2cd37db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8c942c7ba54955bb64d3235845500d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.648293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291bd973f2d945da956d354a2f7071d0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.649026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291bd973f2d945da956d354a2f7071d0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.661217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1025/2020] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:47 2022] DELETE /identity/v3/users/291bd973f2d945da956d354a2f7071d0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:47.666160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 996/2021] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:47 2022] DELETE /identity/v3/users/eb8c942c7ba54955bb64d3235845500d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:47.667256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:47.669049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:47.670189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.670550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.670905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.691026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:47.692923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:47.757546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310643b-283f-473f-a713-bcae910b1914 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:47.783367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 997/2022] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:47.790919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:47.792919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:47.826351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:47.858207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:47.858882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.859161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.859411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] PATH_INFO: `/v3/projects/b315cd8612444f44be26384e0e24b49a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.861964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b315cd8612444f44be26384e0e24b49a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:47.863952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:47.889007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3db0-1bc3-4cb4-93ae-97a9c352c54f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:47.894604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:47.895297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:47.895992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:47.896290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:47.909846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:47.911211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:47.911423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:47.923945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 998/2023] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:47.927399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b315cd8612444f44be26384e0e24b49a', 'request_id': 'req-33698015-4c83-4669-aa69-f4d4fa2222bd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.937764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b315cd8612444f44be26384e0e24b49a', 'request_id': 'req-33698015-4c83-4669-aa69-f4d4fa2222bd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.955746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b315cd8612444f44be26384e0e24b49a', 'request_id': 'req-33698015-4c83-4669-aa69-f4d4fa2222bd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.973287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] The token cache is being invalidate because project b315cd8612444f44be26384e0e24b49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:47.974006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.974691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:47.979371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1026/2024] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:47 2022] DELETE /identity/v3/projects/b315cd8612444f44be26384e0e24b49a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:47.981182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:47.982701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:48.000041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f4506-4d61-4775-98bb-250f55102f7d service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:48.109797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:48.111642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:48.112370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:48.112805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] PATH_INFO: `/v3/users/1afc782bcc144ea39fa9fd97b349e645` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:48.114951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afc782bcc144ea39fa9fd97b349e645)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:48.118379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:48.204109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afc782bcc144ea39fa9fd97b349e645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.215951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afc782bcc144ea39fa9fd97b349e645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.217109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afc782bcc144ea39fa9fd97b349e645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.222660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afc782bcc144ea39fa9fd97b349e645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.229600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afc782bcc144ea39fa9fd97b349e645'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.260332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 999/2025] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:47 2022] DELETE /identity/v3/users/1afc782bcc144ea39fa9fd97b349e645 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:48.334108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:48.335632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:48.348725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33698015-4c83-4669-aa69-f4d4fa2222bd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:48.446570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:48.455887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:48.456292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:48.456588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] PATH_INFO: `/v3/projects/a578e50a78354a0387ff1f3809980379` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:48.458243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a578e50a78354a0387ff1f3809980379)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:48.460187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:48.526624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a578e50a78354a0387ff1f3809980379', 'request_id': 'req-69e235bb-5d95-4f58-bef8-f404475a12c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.535238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a578e50a78354a0387ff1f3809980379', 'request_id': 'req-69e235bb-5d95-4f58-bef8-f404475a12c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.555359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a578e50a78354a0387ff1f3809980379', 'request_id': 'req-69e235bb-5d95-4f58-bef8-f404475a12c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.586476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] The token cache is being invalidate because project a578e50a78354a0387ff1f3809980379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:48.587008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.591777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.594965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1027/2026] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:48 2022] DELETE /identity/v3/projects/a578e50a78354a0387ff1f3809980379 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:48.601674 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:48.602089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:48.621775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecceaf-40af-40ac-8f14-6f7c12f77ada admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:48.702320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:48.703853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:48.726932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:48.752628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:48.753893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:48.754357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:48.754637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] PATH_INFO: `/v3/users/03d7df6d0bde434ab29246030a2224fa` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:48.756008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d7df6d0bde434ab29246030a2224fa)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:48.758177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:48.866940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:48.895191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d7df6d0bde434ab29246030a2224fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.914343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e235bb-5d95-4f58-bef8-f404475a12c2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:48.914941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d7df6d0bde434ab29246030a2224fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.916492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d7df6d0bde434ab29246030a2224fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.918086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d7df6d0bde434ab29246030a2224fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.936384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:48.937823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:48.938136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:48.939649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] PATH_INFO: `/v3/projects/aaa497fb4c6d4f1a97d7fd2884b39919` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:48.941053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa497fb4c6d4f1a97d7fd2884b39919)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:48.942689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d7df6d0bde434ab29246030a2224fa'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:48.944018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:48.993081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1000/2027] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:48 2022] DELETE /identity/v3/users/03d7df6d0bde434ab29246030a2224fa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:48.994832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:49.004299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:49.064539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa497fb4c6d4f1a97d7fd2884b39919', 'request_id': 'req-774288ba-4d14-48c2-b00f-e792ae568afa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.086316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa497fb4c6d4f1a97d7fd2884b39919', 'request_id': 'req-774288ba-4d14-48c2-b00f-e792ae568afa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.106832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa497fb4c6d4f1a97d7fd2884b39919', 'request_id': 'req-774288ba-4d14-48c2-b00f-e792ae568afa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.132542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] The token cache is being invalidate because project aaa497fb4c6d4f1a97d7fd2884b39919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:49.132841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.134916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.138434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1028/2028] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:48 2022] DELETE /identity/v3/projects/aaa497fb4c6d4f1a97d7fd2884b39919 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:49.142465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:49.146824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:49.168060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316f53b-e487-42a1-9d18-5c637d00b73e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:49.320302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774288ba-4d14-48c2-b00f-e792ae568afa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:49.333610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:49.335002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:49.335594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:49.336057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] PATH_INFO: `/v3/users/1990bfbdad05460cb9559882bcd0a65c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:49.336537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:49.338371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:49.338662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:49.338827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1990bfbdad05460cb9559882bcd0a65c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:49.338987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] PATH_INFO: `/v3/projects/329d0010500640c9be9191a6ba7993d4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:49.340181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] RBAC: Authorizing `identity:delete_project(project_id=329d0010500640c9be9191a6ba7993d4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:49.341516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:49.342304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:49.358107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:49.424745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '329d0010500640c9be9191a6ba7993d4', 'request_id': 'req-fa6dda07-458a-4d85-82bc-f1ac9d84488a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.436147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '329d0010500640c9be9191a6ba7993d4', 'request_id': 'req-fa6dda07-458a-4d85-82bc-f1ac9d84488a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.447282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1990bfbdad05460cb9559882bcd0a65c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.458458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '329d0010500640c9be9191a6ba7993d4', 'request_id': 'req-fa6dda07-458a-4d85-82bc-f1ac9d84488a'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.464934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1990bfbdad05460cb9559882bcd0a65c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.465885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1990bfbdad05460cb9559882bcd0a65c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.486257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] The token cache is being invalidate because project 329d0010500640c9be9191a6ba7993d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:49.486589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.487582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1990bfbdad05460cb9559882bcd0a65c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.489097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1990bfbdad05460cb9559882bcd0a65c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.489871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fa6dda07-458a-4d85-82bc-f1ac9d84488a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.501743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1001/2029] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:48 2022] DELETE /identity/v3/projects/329d0010500640c9be9191a6ba7993d4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:49.503636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:49.504426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b335f40-edaf-40ee-b2db-cd0d22ff8759 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:49.504829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b335f40-edaf-40ee-b2db-cd0d22ff8759 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:49.505230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b335f40-edaf-40ee-b2db-cd0d22ff8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:49.510225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1029/2030] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:49 2022] DELETE /identity/v3/users/1990bfbdad05460cb9559882bcd0a65c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:49.529270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4b335f40-edaf-40ee-b2db-cd0d22ff8759 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:49.530679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4b335f40-edaf-40ee-b2db-cd0d22ff8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:49.564205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:49.568237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:49.672150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1002/2031] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:49.680222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e953-dad6-4657-ab1c-15d1cdcecc7e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:49.680669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e953-dad6-4657-ab1c-15d1cdcecc7e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:49.681098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e953-dad6-4657-ab1c-15d1cdcecc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:49.722541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c522e953-dad6-4657-ab1c-15d1cdcecc7e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:49.723920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c522e953-dad6-4657-ab1c-15d1cdcecc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:49.736425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1003/2032] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:49.741391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e953-dad6-4657-ab1c-15d1cdcecc7e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:49.780212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e953-dad6-4657-ab1c-15d1cdcecc7e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:49.788030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:49.789251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:49.789581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:49.789865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:49.791139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619bb0e-f6e4-47c2-9d30-e25da20a2018 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:49.791284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:49.791441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:49.793459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:49.822045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1004/2033] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:49.827471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:49.828390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:49.833403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:49.834990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:49.835430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] PATH_INFO: `/v3/projects/ace2170f8235401a95cc4d92020bdc09` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:49.839422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace2170f8235401a95cc4d92020bdc09)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:49.843619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:49.849253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc8c7d-dac2-4388-a131-86ace1c2e8c8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:49.855161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:49.855866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:49.856120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:49.856401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:49.857102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:49.859571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:49.901766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1005/2034] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:49 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:49.908292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:49.960295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace2170f8235401a95cc4d92020bdc09', 'request_id': 'req-4044786a-99d8-4fec-9f35-61fa81ac9be0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.981173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace2170f8235401a95cc4d92020bdc09', 'request_id': 'req-4044786a-99d8-4fec-9f35-61fa81ac9be0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:49.999305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace2170f8235401a95cc4d92020bdc09', 'request_id': 'req-4044786a-99d8-4fec-9f35-61fa81ac9be0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.018199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] The token cache is being invalidate because project ace2170f8235401a95cc4d92020bdc09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:50.018365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.019056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4044786a-99d8-4fec-9f35-61fa81ac9be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.020904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1030/2035] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:49 2022] DELETE /identity/v3/projects/ace2170f8235401a95cc4d92020bdc09 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:50.029095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645633be-d054-40dc-ac16-fe3490de40d8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.029521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645633be-d054-40dc-ac16-fe3490de40d8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.029978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645633be-d054-40dc-ac16-fe3490de40d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.044071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedbd89-1b4f-4fa2-99b3-266393ca9826 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.052912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:50.067937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-645633be-d054-40dc-ac16-fe3490de40d8 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:50.069891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-645633be-d054-40dc-ac16-fe3490de40d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.136225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.137097 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.137508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.137702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.138485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.140433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.164800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1006/2036] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:49 2022] POST /identity/v3/users => generated 291 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:50.167302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1031/2037] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:50.171469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.173405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.176087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5032-7bb2-4308-8a66-cdf7d8ccb4bd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.176516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5032-7bb2-4308-8a66-cdf7d8ccb4bd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.176898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5032-7bb2-4308-8a66-cdf7d8ccb4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.199842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381b66c-ae91-47ad-81d6-2e1c9294c36a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.210863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1b5b5032-7bb2-4308-8a66-cdf7d8ccb4bd None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:50.213003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1b5b5032-7bb2-4308-8a66-cdf7d8ccb4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.214182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.214849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.216415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.216743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.218736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.221518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.227658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1032/2038] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:50.229384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5032-7bb2-4308-8a66-cdf7d8ccb4bd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.249536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5032-7bb2-4308-8a66-cdf7d8ccb4bd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.251358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1007/2039] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:50.252647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.258906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.261231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.262741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.263378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.263873 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.265038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:50.265523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.268071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.277890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e060300-9975-4a18-9491-c5b79e32ed7d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.285174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1033/2040] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:50.287044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.300722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.301846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.302403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.303124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] PATH_INFO: `/v3/projects/193ebf40c3e94223874675b152f572ea` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.305091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=193ebf40c3e94223874675b152f572ea)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.305468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b9297-45dd-4a98-83d5-567b91dadb27 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.309294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.312356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.313054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.313367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.313720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.314468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.316185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.318983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:50.332791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1034/2041] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:50.333794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.357265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39253e94-6b2e-4724-94bc-058465de62bf admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.363400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.364134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.364450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.364730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.365569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.367785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.397522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193ebf40c3e94223874675b152f572ea', 'request_id': 'req-a58e4a1f-e53f-48d0-a823-31f17fa7b090'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.406684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1035/2042] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:50 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:50.407421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.412391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193ebf40c3e94223874675b152f572ea', 'request_id': 'req-a58e4a1f-e53f-48d0-a823-31f17fa7b090'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.423442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193ebf40c3e94223874675b152f572ea', 'request_id': 'req-a58e4a1f-e53f-48d0-a823-31f17fa7b090'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.449685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] The token cache is being invalidate because project 193ebf40c3e94223874675b152f572ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:50.450174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.451117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.453975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1008/2043] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:50 2022] DELETE /identity/v3/projects/193ebf40c3e94223874675b152f572ea => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:50.454758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.456316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.498364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609cfd3-dca2-47a9-807e-4975c13f475b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.504453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.505393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.505690 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.505973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] PATH_INFO: `/v3/projects/3cafeec1deb546afbb02dc72f1a13dfd/users/b2156b532d21469aa446b60a9adc51b5/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.524112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cafeec1deb546afbb02dc72f1a13dfd, user_id=b2156b532d21469aa446b60a9adc51b5, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.527375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.557771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1036/2044] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:50 2022] PUT /identity/v3/projects/3cafeec1deb546afbb02dc72f1a13dfd/users/b2156b532d21469aa446b60a9adc51b5/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:50.567288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.567288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.575567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e4a1f-e53f-48d0-a823-31f17fa7b090 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.599450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:50.663965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e5871-208a-41dc-a7d0-f6c100ad696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.664651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5871-208a-41dc-a7d0-f6c100ad696d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.664944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5871-208a-41dc-a7d0-f6c100ad696d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.665222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e5871-208a-41dc-a7d0-f6c100ad696d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.666784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e5871-208a-41dc-a7d0-f6c100ad696d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.667335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce43ba-1ec7-40ab-af9f-ddfae8301989 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.669256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e5871-208a-41dc-a7d0-f6c100ad696d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.674159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.675055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.675706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.675706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] PATH_INFO: `/v3/users/4809ced5da4b4391b5fe021c9b45fe2b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.677114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4809ced5da4b4391b5fe021c9b45fe2b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.679496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.694183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1009/2045] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:50 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:50.695516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.695813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.696097 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.747222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] MFA Rules not processed for user `b2156b532d21469aa446b60a9adc51b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:50.748438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.758893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4809ced5da4b4391b5fe021c9b45fe2b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.770226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4809ced5da4b4391b5fe021c9b45fe2b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.773438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4809ced5da4b4391b5fe021c9b45fe2b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.782062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:50.793064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4809ced5da4b4391b5fe021c9b45fe2b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.795161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4809ced5da4b4391b5fe021c9b45fe2b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:50.816678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1037/2046] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:50 2022] DELETE /identity/v3/users/4809ced5da4b4391b5fe021c9b45fe2b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:50.821126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.823521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.896594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1010/2047] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:50.898570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.900098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:50.916143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15df30-21bf-4d54-b77f-102e42791cbd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.916803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd46d4e-3839-463f-a2d7-6753951561c7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.921892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.922077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:50.922923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.923300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.923689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.924460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.926510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.928154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:50.928451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:50.928945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:50.929585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:50.931957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:50.947222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1038/2048] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:50.948806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:50.967675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb28982-6988-4dad-a2de-be986f9d6b7b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:50.969970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1011/2049] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:50 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:50.974030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.071691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.072790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.073195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.073601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.074557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.076513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.097961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1039/2050] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:51.099056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.110713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09783d6-687e-43c5-a9b5-bcbcb59f761b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.116319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.116842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.117230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.117651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] PATH_INFO: `/v3/projects/c84c4c6ca28f4393aa5aafda0ef1b72f/users/90777774c21844dab08c524c5c203445/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.126580 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f0ac4-8581-4f13-9ece-7aeaa1f2e5a1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.131959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe69c8-657b-4ae2-b7bb-dadf747213a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.133139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe69c8-657b-4ae2-b7bb-dadf747213a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.133688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe69c8-657b-4ae2-b7bb-dadf747213a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.134419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe69c8-657b-4ae2-b7bb-dadf747213a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.135541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe69c8-657b-4ae2-b7bb-dadf747213a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.138465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe69c8-657b-4ae2-b7bb-dadf747213a1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.142884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84c4c6ca28f4393aa5aafda0ef1b72f, user_id=90777774c21844dab08c524c5c203445, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.148930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.178742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1040/2051] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:51 2022] PUT /identity/v3/projects/c84c4c6ca28f4393aa5aafda0ef1b72f/users/90777774c21844dab08c524c5c203445/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:51.188852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1012/2052] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:50 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:51.192955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.194123 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9dc7f-f75d-405c-90cf-edb04f168110 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.194438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9dc7f-f75d-405c-90cf-edb04f168110 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.194762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9dc7f-f75d-405c-90cf-edb04f168110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.206859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:51.236873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-99c9dc7f-f75d-405c-90cf-edb04f168110 None None] MFA Rules not processed for user `90777774c21844dab08c524c5c203445`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:51.238521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-99c9dc7f-f75d-405c-90cf-edb04f168110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.276719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:51.304795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc220e8-8841-42da-8188-6867c5f57e13 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.324654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.325766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.326227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.326542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.327735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.331181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.346974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1041/2053] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:51.347975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.350574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.370651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1013/2054] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:51.375242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9dc7f-f75d-405c-90cf-edb04f168110 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.386256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcf518-8eec-46d1-84fd-06dda247faa8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.391240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.392193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.392542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.392818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] PATH_INFO: `/v3/projects/345a38ce9c1c41bda753142b3e2f3917` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.393273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9dc7f-f75d-405c-90cf-edb04f168110 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.394071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=345a38ce9c1c41bda753142b3e2f3917)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.396110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.398510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.399399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.399789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.400070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] PATH_INFO: `/v3/projects/64473113a0a840fabf21cac6511d74a2/users/7205c7bda859415eb746c1fe6344bb0b/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.416264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64473113a0a840fabf21cac6511d74a2, user_id=7205c7bda859415eb746c1fe6344bb0b, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.419001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.434553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1014/2055] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:51 2022] PUT /identity/v3/projects/64473113a0a840fabf21cac6511d74a2/users/7205c7bda859415eb746c1fe6344bb0b/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:51.435532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.437447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.445010 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345a38ce9c1c41bda753142b3e2f3917', 'request_id': 'req-41779bfc-3b53-4f3b-9d0a-4622c54264eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:51.450960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345a38ce9c1c41bda753142b3e2f3917', 'request_id': 'req-41779bfc-3b53-4f3b-9d0a-4622c54264eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:51.458291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345a38ce9c1c41bda753142b3e2f3917', 'request_id': 'req-41779bfc-3b53-4f3b-9d0a-4622c54264eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:51.470114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] The token cache is being invalidate because project 345a38ce9c1c41bda753142b3e2f3917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:51.470404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:51.471058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:51.472833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1042/2056] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:51 2022] DELETE /identity/v3/projects/345a38ce9c1c41bda753142b3e2f3917 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:51.473405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.474719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.504811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59f0ce-31d0-40d1-bc04-309825e0a01c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.547584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41779bfc-3b53-4f3b-9d0a-4622c54264eb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.553499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ab3c0-35f7-4c20-9147-9d11a1b1e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.554150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab3c0-35f7-4c20-9147-9d11a1b1e57b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.554540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab3c0-35f7-4c20-9147-9d11a1b1e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.554837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ab3c0-35f7-4c20-9147-9d11a1b1e57b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.555606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ab3c0-35f7-4c20-9147-9d11a1b1e57b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.558243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991f295-0ad3-42d7-9a48-6522615e191b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.558396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ab3c0-35f7-4c20-9147-9d11a1b1e57b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.558911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991f295-0ad3-42d7-9a48-6522615e191b service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.559196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991f295-0ad3-42d7-9a48-6522615e191b service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.559506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991f295-0ad3-42d7-9a48-6522615e191b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.562047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6991f295-0ad3-42d7-9a48-6522615e191b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.569860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1043/2057] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:51.571433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09998-8f15-4671-a099-4b673ef8042a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.572868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09998-8f15-4671-a099-4b673ef8042a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.573160 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09998-8f15-4671-a099-4b673ef8042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.593577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bae09998-8f15-4671-a099-4b673ef8042a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:51.595045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bae09998-8f15-4671-a099-4b673ef8042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.606012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1044/2058] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:51.607887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09998-8f15-4671-a099-4b673ef8042a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.616620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09998-8f15-4671-a099-4b673ef8042a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.622019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b14b3-f24f-48ba-80d5-e8244a46be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.623245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b14b3-f24f-48ba-80d5-e8244a46be1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.623369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:51.623505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b14b3-f24f-48ba-80d5-e8244a46be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.623505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b14b3-f24f-48ba-80d5-e8244a46be1f admin admin] PATH_INFO: `/v3/projects/64473113a0a840fabf21cac6511d74a2/users/7205c7bda859415eb746c1fe6344bb0b/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.625586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b14b3-f24f-48ba-80d5-e8244a46be1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64473113a0a840fabf21cac6511d74a2, user_id=7205c7bda859415eb746c1fe6344bb0b, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.628220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b14b3-f24f-48ba-80d5-e8244a46be1f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.640783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1045/2059] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:51 2022] PUT /identity/v3/projects/64473113a0a840fabf21cac6511d74a2/users/7205c7bda859415eb746c1fe6344bb0b/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:51.642093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03485c-b90f-475e-ab9f-835d56e7b0f2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.642376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03485c-b90f-475e-ab9f-835d56e7b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.643216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03485c-b90f-475e-ab9f-835d56e7b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.661039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991f295-0ad3-42d7-9a48-6522615e191b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.662578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991f295-0ad3-42d7-9a48-6522615e191b service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.663648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ee03485c-b90f-475e-ab9f-835d56e7b0f2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:51.664875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ee03485c-b90f-475e-ab9f-835d56e7b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.676599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1015/2060] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:51.678982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.679278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.679562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.715706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] MFA Rules not processed for user `7205c7bda859415eb746c1fe6344bb0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:51.716318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.729119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:51.765382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1046/2061] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:51.769861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03485c-b90f-475e-ab9f-835d56e7b0f2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.781950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03485c-b90f-475e-ab9f-835d56e7b0f2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.788199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.789179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.789796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.790083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.791197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:51.791197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.793874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.815409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1047/2062] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:51.816730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.829904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20ceb-0b34-4196-a40e-6c949966e30a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.844864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.845741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.846053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.846388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.847076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.850159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:51.865321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1016/2063] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:51.882695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.884695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:51.890841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1048/2064] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:51 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:51.892041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:51.952553 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ac335-7322-4425-b0fb-20c1b2f8b4c8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.971092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd59a-ec2c-4b46-b367-b9a0d93657e7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:51.977523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:51.979033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:51.979577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:51.980136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:51.980919 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:51.983131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.012684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1049/2065] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:51 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:52.018017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:52.026818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbef9e-da97-424b-bbf5-47ef08685735 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.027380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbef9e-da97-424b-bbf5-47ef08685735 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.027680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbef9e-da97-424b-bbf5-47ef08685735 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.027932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbef9e-da97-424b-bbf5-47ef08685735 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.034024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf7eeb-35d0-4c04-ad71-b8344f383fae admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:52.041024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.041762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.042044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.042324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.043078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.044851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.059215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1050/2066] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:52.064360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:52.090112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b16ad-65d7-4327-8ad7-fd3f6287a458 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:52.096741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.097548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.098041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.098331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.100388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.102804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.115966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:52.121734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1051/2067] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:52.122932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:52.157070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa1d42-b760-4e5f-986b-2dbd970ad119 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:52.160629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbef9e-da97-424b-bbf5-47ef08685735 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.162666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbef9e-da97-424b-bbf5-47ef08685735 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.170465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.171368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.171648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.171962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] PATH_INFO: `/v3/projects/ba96105733ea472eb897c261a770e9a6/users/52490fb84bb343d9af6eeaae1dc50aa8/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.194435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1017/2068] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:52.205588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba96105733ea472eb897c261a770e9a6, user_id=52490fb84bb343d9af6eeaae1dc50aa8, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.218723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.241670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1052/2069] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:52 2022] PUT /identity/v3/projects/ba96105733ea472eb897c261a770e9a6/users/52490fb84bb343d9af6eeaae1dc50aa8/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:52.250919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.251810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.251810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.285909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:52.287431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:52.338808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:52.343618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:52.421618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1018/2070] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:52.431739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:52.433976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:52.488361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:52.506308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da96d3-ba2b-4454-919a-2680c598d766 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:52.512571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.513757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.514239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.514931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] PATH_INFO: `/v3/users/9260d29108b141ce90ecbf2b20eb3a98` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.516710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9260d29108b141ce90ecbf2b20eb3a98)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.519033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.583754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c884d2c-0a74-405a-92ee-84ccd0170051 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:52.589396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d09a71-c5f1-4933-a4b0-0fd42eacac6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.590535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d09a71-c5f1-4933-a4b0-0fd42eacac6e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.590985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d09a71-c5f1-4933-a4b0-0fd42eacac6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.591363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d09a71-c5f1-4933-a4b0-0fd42eacac6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.608665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9260d29108b141ce90ecbf2b20eb3a98'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.609371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d09a71-c5f1-4933-a4b0-0fd42eacac6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.611202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d09a71-c5f1-4933-a4b0-0fd42eacac6e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.620226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9260d29108b141ce90ecbf2b20eb3a98'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.621103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9260d29108b141ce90ecbf2b20eb3a98'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.636668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9260d29108b141ce90ecbf2b20eb3a98'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.641992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9260d29108b141ce90ecbf2b20eb3a98'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.650626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1019/2071] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:52.680717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1053/2072] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:52 2022] DELETE /identity/v3/users/9260d29108b141ce90ecbf2b20eb3a98 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:52.686451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.686751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.687079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.725448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:52.726773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:52.845439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1020/2073] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:52.860731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:52.860731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:52.878297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:52.880579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:52.897873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ad06d-2051-45e2-8649-f2b39dc77786 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:52.903594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.904538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.904827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.905112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] PATH_INFO: `/v3/users/b2156b532d21469aa446b60a9adc51b5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.906456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2156b532d21469aa446b60a9adc51b5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.908427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.915852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:52.939536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc6e8b-04a7-469e-a8f7-7ddb5bfcfc3c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:52.944791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d42220-1e83-4959-bbef-6ed175b3d3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:52.945605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42220-1e83-4959-bbef-6ed175b3d3ab service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:52.946027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42220-1e83-4959-bbef-6ed175b3d3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:52.946971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d42220-1e83-4959-bbef-6ed175b3d3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:52.959824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42220-1e83-4959-bbef-6ed175b3d3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:52.961233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d42220-1e83-4959-bbef-6ed175b3d3ab service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:52.971874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2156b532d21469aa446b60a9adc51b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.975934 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1054/2074] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:52.985696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2156b532d21469aa446b60a9adc51b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.986352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2156b532d21469aa446b60a9adc51b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.987100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2156b532d21469aa446b60a9adc51b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:52.995700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2156b532d21469aa446b60a9adc51b5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.016360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1021/2075] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:52 2022] DELETE /identity/v3/users/b2156b532d21469aa446b60a9adc51b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:53.020973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:53.021273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:53.021578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:53.047255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:53.048501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:53.141420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1055/2076] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:53.148763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:53.150348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:53.216207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021c77f-a98a-442e-8f25-2603d43ce0f9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:53.220699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:53.221535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:53.222265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:53.222265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:53.234795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:53.237087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:53.250432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1022/2077] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:53.585948 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:53.589305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:53.626485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c9017-fe63-4e9d-8718-bbe7e228ad63 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:53.633135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:53.634556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:53.634843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:53.635122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] PATH_INFO: `/v3/projects/3dcc8377915e4f60971520fb387149e4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:53.637660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcc8377915e4f60971520fb387149e4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:53.643980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:53.644243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:53.647427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:53.669801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19bcbe-a0db-4b39-8c3f-bd9f7ead78c5 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:53.678146 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:53.678945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:53.682201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:53.683045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:53.683964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] PATH_INFO: `/v3/projects/3cafeec1deb546afbb02dc72f1a13dfd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:53.702317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cafeec1deb546afbb02dc72f1a13dfd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:53.705025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:53.759786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcc8377915e4f60971520fb387149e4', 'request_id': 'req-7a70d557-29a1-46db-a3d1-add7fd6cf63f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.783615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcc8377915e4f60971520fb387149e4', 'request_id': 'req-7a70d557-29a1-46db-a3d1-add7fd6cf63f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.798419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cafeec1deb546afbb02dc72f1a13dfd', 'request_id': 'req-3195ea7b-365c-4985-9888-4379bb01bbd2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.803047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcc8377915e4f60971520fb387149e4', 'request_id': 'req-7a70d557-29a1-46db-a3d1-add7fd6cf63f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.828773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cafeec1deb546afbb02dc72f1a13dfd', 'request_id': 'req-3195ea7b-365c-4985-9888-4379bb01bbd2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.840134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] The token cache is being invalidate because project 3dcc8377915e4f60971520fb387149e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:53.840453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.841886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cafeec1deb546afbb02dc72f1a13dfd', 'request_id': 'req-3195ea7b-365c-4985-9888-4379bb01bbd2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.850624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a70d557-29a1-46db-a3d1-add7fd6cf63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.852439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1056/2078] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:53 2022] DELETE /identity/v3/projects/3dcc8377915e4f60971520fb387149e4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:53.854077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:53.854374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:53.854643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:53.867443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] The token cache is being invalidate because project 3cafeec1deb546afbb02dc72f1a13dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:53.871135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.872792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:53.881803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1023/2079] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:53 2022] DELETE /identity/v3/projects/3cafeec1deb546afbb02dc72f1a13dfd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:53.889330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:53.891021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:53.927582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:53.932942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] MFA Rules not processed for user `52490fb84bb343d9af6eeaae1dc50aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:53.934221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:54.074780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ea7b-365c-4985-9888-4379bb01bbd2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:54.099205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:54.099205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:54.099205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:54.099205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] PATH_INFO: `/v3/users/0d92695a6e4b44c1be462469b5bdf324` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:54.101370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d92695a6e4b44c1be462469b5bdf324)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:54.105109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:54.148217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1057/2080] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:54.150331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:54.154089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:54.184272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025793c-8438-466c-9675-fdcec8e79133 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:54.189645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:54.190565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:54.190912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:54.191585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] PATH_INFO: `/v3/users/7205c7bda859415eb746c1fe6344bb0b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:54.194406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7205c7bda859415eb746c1fe6344bb0b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:54.197176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:54.223808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d92695a6e4b44c1be462469b5bdf324'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.236004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d92695a6e4b44c1be462469b5bdf324'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.236912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d92695a6e4b44c1be462469b5bdf324'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.237795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d92695a6e4b44c1be462469b5bdf324'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.250344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d92695a6e4b44c1be462469b5bdf324'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.278965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7205c7bda859415eb746c1fe6344bb0b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.282249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1024/2081] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:53 2022] DELETE /identity/v3/users/0d92695a6e4b44c1be462469b5bdf324 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:54.283531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:54.286261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:54.295210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7205c7bda859415eb746c1fe6344bb0b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.296272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7205c7bda859415eb746c1fe6344bb0b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.331915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7205c7bda859415eb746c1fe6344bb0b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.335585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7205c7bda859415eb746c1fe6344bb0b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:54.360896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:54.364653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562750b-a914-40b5-96e2-6138a3b97bed admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:54.369721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:54.370531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:54.370891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:54.371259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:54.373579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:54.378051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1058/2082] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:54 2022] DELETE /identity/v3/users/7205c7bda859415eb746c1fe6344bb0b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:54.447381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:54.480853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:54.482931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:54.523428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1025/2083] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:54.900714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:54.904808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:55.015587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.018120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:55.093286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2ea4-ff28-485a-a2c6-535a6b426ad9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.107531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.108544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.108768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.109066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] PATH_INFO: `/v3/projects/9ed677e185594c6888263aaf65e6a571` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.110497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed677e185594c6888263aaf65e6a571)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.112492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.167975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac927af-42f3-4b74-b711-08dfd22cd8fc service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.188096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.189002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.189286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.189597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] PATH_INFO: `/v3/projects/64473113a0a840fabf21cac6511d74a2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.193524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64473113a0a840fabf21cac6511d74a2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.195483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.258569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed677e185594c6888263aaf65e6a571', 'request_id': 'req-3ade9895-a68f-436c-bb33-9813c93d4684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.276492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed677e185594c6888263aaf65e6a571', 'request_id': 'req-3ade9895-a68f-436c-bb33-9813c93d4684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.298061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed677e185594c6888263aaf65e6a571', 'request_id': 'req-3ade9895-a68f-436c-bb33-9813c93d4684'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.308567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64473113a0a840fabf21cac6511d74a2', 'request_id': 'req-f60f2161-4541-41aa-a1fe-9fb22327139c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.321174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64473113a0a840fabf21cac6511d74a2', 'request_id': 'req-f60f2161-4541-41aa-a1fe-9fb22327139c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.323465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] The token cache is being invalidate because project 9ed677e185594c6888263aaf65e6a571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:55.325195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.328531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3ade9895-a68f-436c-bb33-9813c93d4684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.332222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1059/2084] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:54 2022] DELETE /identity/v3/projects/9ed677e185594c6888263aaf65e6a571 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:55.332977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64473113a0a840fabf21cac6511d74a2', 'request_id': 'req-f60f2161-4541-41aa-a1fe-9fb22327139c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.337654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450a8a-64ca-451f-bb44-5bcb8c95dacd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.338213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450a8a-64ca-451f-bb44-5bcb8c95dacd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.339188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8450a8a-64ca-451f-bb44-5bcb8c95dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.379496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] The token cache is being invalidate because project 64473113a0a840fabf21cac6511d74a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:55.381489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.383849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-f60f2161-4541-41aa-a1fe-9fb22327139c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:55.392204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1026/2085] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:55 2022] DELETE /identity/v3/projects/64473113a0a840fabf21cac6511d74a2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:55.393880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f8450a8a-64ca-451f-bb44-5bcb8c95dacd None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:55.394029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b90530-bb33-408c-a1e1-3458f660d752 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.394376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b90530-bb33-408c-a1e1-3458f660d752 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.394722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b90530-bb33-408c-a1e1-3458f660d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.396664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f8450a8a-64ca-451f-bb44-5bcb8c95dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:55.439707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f8b90530-bb33-408c-a1e1-3458f660d752 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:55.440960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f8b90530-bb33-408c-a1e1-3458f660d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:55.491187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1060/2086] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:55.503305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e2f6-c96a-457a-921f-41b5be5ce2b1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.503717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e2f6-c96a-457a-921f-41b5be5ce2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.504291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e2f6-c96a-457a-921f-41b5be5ce2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.528160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1027/2087] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:55.531891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d001e2f6-c96a-457a-921f-41b5be5ce2b1 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:55.533825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d001e2f6-c96a-457a-921f-41b5be5ce2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:55.536221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10c27-37c4-41f5-8f4f-eacfd5265947 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.536515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10c27-37c4-41f5-8f4f-eacfd5265947 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.536799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10c27-37c4-41f5-8f4f-eacfd5265947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.548486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1061/2088] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:55.550488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001e2f6-c96a-457a-921f-41b5be5ce2b1 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.555223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b5f10c27-37c4-41f5-8f4f-eacfd5265947 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:55.560719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5f10c27-37c4-41f5-8f4f-eacfd5265947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:55.570604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1028/2089] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:55.575271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001e2f6-c96a-457a-921f-41b5be5ce2b1 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.576126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f10c27-37c4-41f5-8f4f-eacfd5265947 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.581335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.582167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.582462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.582737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.583518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:55.583847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.585620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.587572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f10c27-37c4-41f5-8f4f-eacfd5265947 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.594560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.595435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.595719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.595997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.596743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:55.597053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.598709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.601613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:55.606898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1062/2090] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:55.611830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.619158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1029/2091] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:55.623903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.629486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698aa27-bea4-41aa-81fa-b35695fb3eb4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.636206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab3857-f5f3-4c96-9c4c-bdee2bc9ffcf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.636638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.637593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.638106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.638945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.640494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.641286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.642153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.642445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.642726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.643571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.644667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.645783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.654489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:55.688935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1030/2092] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:55.691720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1063/2093] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:55.693878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.696021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.776834 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560242f1-bf41-4c38-82c9-64d2618aed4c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.776980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5e207-6809-44c3-ab32-dbcd90025f5a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.780011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.780549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.780693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.780985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.781263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.781481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.781823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.782029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.782330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.783091 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.784020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.785166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.805391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1064/2094] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:55.807222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1031/2095] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:55.810722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.811084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.821717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab574b2f-6766-415f-9677-5e99532314aa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.823351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79366a5c-8509-40b6-ae84-57c10012edd3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.826840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.827569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.827908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.828072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.828242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.828744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.829029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.829134 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.829310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.830174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.830725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.831778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.844274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1032/2096] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:55.844444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1065/2097] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:55.845888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.845998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.857213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2255c-f434-4560-aef9-266b34f834d3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.857511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf6ba2-e030-4fd4-b5a9-f00a024a9b45 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.862278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.862407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.862962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.863063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.863267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.863382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.863571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.863672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.864321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.864438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.866023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.866128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.879663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1066/2098] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:55.879890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1033/2099] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:55.883596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.885533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:55.894773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819891-4304-4757-bf72-7cb23e1a9df1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.896367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b780ca1-96be-47f3-9386-223e930d1cbc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:55.899991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28f109-6ac9-4fee-b9bd-5463be75953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.901113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f109-6ac9-4fee-b9bd-5463be75953d admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.901693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f109-6ac9-4fee-b9bd-5463be75953d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.901847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28f109-6ac9-4fee-b9bd-5463be75953d admin admin] PATH_INFO: `/v3/projects/f0b01ae2f8f54eea9473547a7dae1041/users/d9d99731dca548b5a711be6376f53924/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.903785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cc416-e014-4c3f-98ee-3750e9057435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:55.904656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc416-e014-4c3f-98ee-3750e9057435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.905006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc416-e014-4c3f-98ee-3750e9057435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.905362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc416-e014-4c3f-98ee-3750e9057435 admin admin] PATH_INFO: `/v3/projects/dfe9c94610544bdb8de5bbada4186777/users/f5ccb8fb73c74e50b462dd86593007a4/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.921366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f109-6ac9-4fee-b9bd-5463be75953d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b01ae2f8f54eea9473547a7dae1041, user_id=d9d99731dca548b5a711be6376f53924, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.924032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28f109-6ac9-4fee-b9bd-5463be75953d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.926454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc416-e014-4c3f-98ee-3750e9057435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe9c94610544bdb8de5bbada4186777, user_id=f5ccb8fb73c74e50b462dd86593007a4, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:55.929333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc416-e014-4c3f-98ee-3750e9057435 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:55.940755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1067/2100] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:55 2022] PUT /identity/v3/projects/f0b01ae2f8f54eea9473547a7dae1041/users/d9d99731dca548b5a711be6376f53924/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:08:55.949915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1034/2101] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:55 2022] PUT /identity/v3/projects/dfe9c94610544bdb8de5bbada4186777/users/f5ccb8fb73c74e50b462dd86593007a4/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:55.952101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb5cd-a919-433a-9411-f54703cbe614 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.952488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb5cd-a919-433a-9411-f54703cbe614 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.952881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fb5cd-a919-433a-9411-f54703cbe614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.960382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:55.962902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:55.962902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:55.984231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-db3fb5cd-a919-433a-9411-f54703cbe614 None None] MFA Rules not processed for user `d9d99731dca548b5a711be6376f53924`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:55.985794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-db3fb5cd-a919-433a-9411-f54703cbe614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:55.997141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] MFA Rules not processed for user `f5ccb8fb73c74e50b462dd86593007a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:55.999409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:56.061707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1068/2102] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:56.067800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fb5cd-a919-433a-9411-f54703cbe614 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.077388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1035/2103] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:56.089630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.091102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:56.102426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:56.113271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:56.159513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fb5cd-a919-433a-9411-f54703cbe614 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.164172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.164830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.165765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.166039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.166820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.168713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.188612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5eedfd-2632-4272-9a2b-d3d609aada95 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.193015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.193640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.193969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.194614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.200732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1069/2104] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:56 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:56.204578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.204877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.206364 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.218387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1036/2105] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:08:56.276364 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7748b2-92b1-4fd6-810c-4afc64a64508 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.281385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.282064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.282344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.282619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.283308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.285242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.311478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1070/2106] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:56 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:08:56.315401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.329374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2337f-a2e2-429e-a419-c4235651b757 service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.334394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.335085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.335368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.335650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.336394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.339038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.350417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1037/2107] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:56.356169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.367028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0892a5-74a3-4f98-9ed9-61640f808383 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.372399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.373365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.373656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.373956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] PATH_INFO: `/v3/projects/7bbbc6fd3687430fae89e5a3b1af6ff0/users/081a75f1e0f04e578caad0c6fa043da3/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.391872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbbc6fd3687430fae89e5a3b1af6ff0, user_id=081a75f1e0f04e578caad0c6fa043da3, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.394729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.409809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1071/2108] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:56 2022] PUT /identity/v3/projects/7bbbc6fd3687430fae89e5a3b1af6ff0/users/081a75f1e0f04e578caad0c6fa043da3/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:56.413601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.426144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af17422-8521-4d99-bc4f-634ebcb3a899 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.491291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067b081-63f8-404c-93b8-d454e528afbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.492055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067b081-63f8-404c-93b8-d454e528afbb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.492415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067b081-63f8-404c-93b8-d454e528afbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.492769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067b081-63f8-404c-93b8-d454e528afbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.493678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067b081-63f8-404c-93b8-d454e528afbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.495399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067b081-63f8-404c-93b8-d454e528afbb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.506159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1038/2109] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:08:56.511129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.526715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84fc11-c660-4c1d-89c8-e93100183fd1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.535628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.536386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.536749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.536923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] PATH_INFO: `/v3/projects/7bbbc6fd3687430fae89e5a3b1af6ff0/users/081a75f1e0f04e578caad0c6fa043da3/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.539026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbbc6fd3687430fae89e5a3b1af6ff0, user_id=081a75f1e0f04e578caad0c6fa043da3, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.543040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.557935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1072/2110] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:56 2022] PUT /identity/v3/projects/7bbbc6fd3687430fae89e5a3b1af6ff0/users/081a75f1e0f04e578caad0c6fa043da3/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:56.572527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e2d3-5a01-4813-8490-c0eca27cb780 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.572824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e2d3-5a01-4813-8490-c0eca27cb780 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.573118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305e2d3-5a01-4813-8490-c0eca27cb780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.601485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e305e2d3-5a01-4813-8490-c0eca27cb780 None None] MFA Rules not processed for user `081a75f1e0f04e578caad0c6fa043da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:56.603367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e305e2d3-5a01-4813-8490-c0eca27cb780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:56.685659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:56.690658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1039/2111] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:56.811527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:56.813340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:56.890619 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b8f28-ed78-4110-a510-b6e61f45c681 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:56.895754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0099e-ae14-40cb-9ce5-2cbc1b92c0d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:56.896863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0099e-ae14-40cb-9ce5-2cbc1b92c0d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:56.897245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0099e-ae14-40cb-9ce5-2cbc1b92c0d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:56.897666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0099e-ae14-40cb-9ce5-2cbc1b92c0d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:56.908174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0099e-ae14-40cb-9ce5-2cbc1b92c0d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:56.909710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0099e-ae14-40cb-9ce5-2cbc1b92c0d9 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:56.915511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:56.923451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1073/2112] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:57.082178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305e2d3-5a01-4813-8490-c0eca27cb780 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:57.150597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305e2d3-5a01-4813-8490-c0eca27cb780 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:57.155182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:57.156087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:57.156368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:57.156639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] PATH_INFO: `/v3/users/d9d99731dca548b5a711be6376f53924` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:57.157889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d99731dca548b5a711be6376f53924)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:57.159798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:57.211185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d99731dca548b5a711be6376f53924'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:57.220107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d99731dca548b5a711be6376f53924'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:57.220734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d99731dca548b5a711be6376f53924'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:57.221367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d99731dca548b5a711be6376f53924'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:57.229516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-824f063d-b676-42c2-873d-df9eb7fa8ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d99731dca548b5a711be6376f53924'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:57.249270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1040/2113] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:57 2022] DELETE /identity/v3/users/d9d99731dca548b5a711be6376f53924 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:57.253595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:57.253949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:57.254231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:57.274100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:57.275901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:57.302647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:57.303007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:57.303331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:57.324716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] MFA Rules not processed for user `52490fb84bb343d9af6eeaae1dc50aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:57.325964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:57.373451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1074/2114] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:57.385375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:57.386880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:57.409050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1041/2115] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:57.456009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657ed6-dc03-453b-8689-f55b461a3f48 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:57.460008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:57.460697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:57.460977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:57.461415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:57.472907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:57.474319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:57.485633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1075/2116] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:57.809751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:57.811864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:57.887066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ee5d-5158-4daf-ae38-d973047551f2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:57.897093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:57.898291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:57.898640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:57.901768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] PATH_INFO: `/v3/projects/f0b01ae2f8f54eea9473547a7dae1041` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:57.909090 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b01ae2f8f54eea9473547a7dae1041)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:57.912125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:57.952212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:57.993465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b01ae2f8f54eea9473547a7dae1041', 'request_id': 'req-c2abfb15-b289-4ceb-ac79-4724a3c8e459'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.016383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b01ae2f8f54eea9473547a7dae1041', 'request_id': 'req-c2abfb15-b289-4ceb-ac79-4724a3c8e459'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.023893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b01ae2f8f54eea9473547a7dae1041', 'request_id': 'req-c2abfb15-b289-4ceb-ac79-4724a3c8e459'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.040708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] The token cache is being invalidate because project f0b01ae2f8f54eea9473547a7dae1041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:58.041591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.042754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.044564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1042/2117] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:57 2022] DELETE /identity/v3/projects/f0b01ae2f8f54eea9473547a7dae1041 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:58.048700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:58.060309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4c61e-a544-4efb-b494-73466e5a0b5e service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:58.142179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:58.143053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.143333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.143607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] PATH_INFO: `/v3/users/081a75f1e0f04e578caad0c6fa043da3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.145156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081a75f1e0f04e578caad0c6fa043da3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:58.147442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:58.220990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:58.224809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081a75f1e0f04e578caad0c6fa043da3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.236944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081a75f1e0f04e578caad0c6fa043da3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.237778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081a75f1e0f04e578caad0c6fa043da3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.297150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081a75f1e0f04e578caad0c6fa043da3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.299202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d4f1cbb7-230d-411b-9f45-5f80af6bc7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081a75f1e0f04e578caad0c6fa043da3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.341446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1076/2118] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:58 2022] DELETE /identity/v3/users/081a75f1e0f04e578caad0c6fa043da3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:58.704280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:58.706559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:58.721953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfb15-b289-4ceb-ac79-4724a3c8e459 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:58.795668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:58.796525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.796825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.797109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] PATH_INFO: `/v3/projects/7bbbc6fd3687430fae89e5a3b1af6ff0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.798441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbbc6fd3687430fae89e5a3b1af6ff0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:58.801030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:58.855071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbbc6fd3687430fae89e5a3b1af6ff0', 'request_id': 'req-2983804d-079e-4778-84a8-7b95e2daa7d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.862736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbbc6fd3687430fae89e5a3b1af6ff0', 'request_id': 'req-2983804d-079e-4778-84a8-7b95e2daa7d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.869059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbbc6fd3687430fae89e5a3b1af6ff0', 'request_id': 'req-2983804d-079e-4778-84a8-7b95e2daa7d3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.882462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] The token cache is being invalidate because project 7bbbc6fd3687430fae89e5a3b1af6ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:08:58.882792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.883544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2983804d-079e-4778-84a8-7b95e2daa7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:58.885826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1043/2119] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:08:58 2022] DELETE /identity/v3/projects/7bbbc6fd3687430fae89e5a3b1af6ff0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:58.891722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599d2b3-3688-4cc5-85fa-0dc013a622bf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.892018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599d2b3-3688-4cc5-85fa-0dc013a622bf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.892300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599d2b3-3688-4cc5-85fa-0dc013a622bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.912180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3599d2b3-3688-4cc5-85fa-0dc013a622bf None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:58.914423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3599d2b3-3688-4cc5-85fa-0dc013a622bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:58.980016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1077/2120] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:58.987878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c034dd-185c-4dee-9d2c-a45fe53f3c69 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.988168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c034dd-185c-4dee-9d2c-a45fe53f3c69 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.988454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c034dd-185c-4dee-9d2c-a45fe53f3c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.007482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-38c034dd-185c-4dee-9d2c-a45fe53f3c69 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:59.008738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-38c034dd-185c-4dee-9d2c-a45fe53f3c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:59.016700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1044/2121] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:59.020969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599d2b3-3688-4cc5-85fa-0dc013a622bf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.031888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599d2b3-3688-4cc5-85fa-0dc013a622bf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.036627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.037300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.037623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.037906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.038642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:08:59.038982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.041451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.053884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1078/2122] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:08:59.058643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c034dd-185c-4dee-9d2c-a45fe53f3c69 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.068240 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c034dd-185c-4dee-9d2c-a45fe53f3c69 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.073545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.074207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.074498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.074786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.075500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.077442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.115716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1045/2123] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:08:59 2022] POST /identity/v3/projects => generated 359 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:59.116840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.127594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a31a6-a207-4b7a-8d0f-3cbd80aabfb0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.199040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.199777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.200138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.200503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.201277 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.203332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.229746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1079/2124] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:08:59 2022] POST /identity/v3/users => generated 280 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:08:59.233763 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.250015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ab4b2-4e5a-4d4a-bec1-d0c5f404f4f0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.255353 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.256121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.256446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.256620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.257372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.259315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.262241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:59.276975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1046/2125] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:59.285717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.296645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79326c75-d6c5-4537-8c3c-395d649c2b1d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.301685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403e953-e988-4b7e-8204-d765bc60d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.302380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e953-e988-4b7e-8204-d765bc60d4aa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.302717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e953-e988-4b7e-8204-d765bc60d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.302995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403e953-e988-4b7e-8204-d765bc60d4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.303724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403e953-e988-4b7e-8204-d765bc60d4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.305891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403e953-e988-4b7e-8204-d765bc60d4aa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.320614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1080/2126] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:08:59.322476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.334239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1bc86-5450-4f42-95ad-55f1b336c4d0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.347533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.348546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.348835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.349127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] PATH_INFO: `/v3/projects/64ede9ea27844a368f2933ce2b5a3da6/users/b160372a2c294c6d921c51ea682505a3/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.368532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ede9ea27844a368f2933ce2b5a3da6, user_id=b160372a2c294c6d921c51ea682505a3, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.372146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.392270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1047/2127] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:08:59 2022] PUT /identity/v3/projects/64ede9ea27844a368f2933ce2b5a3da6/users/b160372a2c294c6d921c51ea682505a3/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:59.402839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd54ac-66e7-4a67-8d17-ca0eb021b8b3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.403153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd54ac-66e7-4a67-8d17-ca0eb021b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.403434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd54ac-66e7-4a67-8d17-ca0eb021b8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.432855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-80bd54ac-66e7-4a67-8d17-ca0eb021b8b3 None None] MFA Rules not processed for user `b160372a2c294c6d921c51ea682505a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:59.434117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-80bd54ac-66e7-4a67-8d17-ca0eb021b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:59.452413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:59.518374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1081/2128] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:59 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:08:59.559778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.562739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:59.657684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c63f0-90f0-476f-8c26-c0f7771518a2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.662153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.663266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.663266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.663652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.681262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.683645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.703582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1048/2129] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:59 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:08:59.720440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd54ac-66e7-4a67-8d17-ca0eb021b8b3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.810390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd54ac-66e7-4a67-8d17-ca0eb021b8b3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.815844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.817436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.817933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.818378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] PATH_INFO: `/v3/users/b160372a2c294c6d921c51ea682505a3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.819922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b160372a2c294c6d921c51ea682505a3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.822950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.885679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:59.887843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:59.893044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b160372a2c294c6d921c51ea682505a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:59.907846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b160372a2c294c6d921c51ea682505a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:59.908574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b160372a2c294c6d921c51ea682505a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:59.911598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f16d63-761d-4569-9186-86c284197b20 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:59.925588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:59.928386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.928676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.929711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b160372a2c294c6d921c51ea682505a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:59.930029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] PATH_INFO: `/v3/users/c8e81314780b46c8bdf5a577ca957827` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:59.932387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e1f9b702-4f36-48f2-850b-d40a5b96c511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b160372a2c294c6d921c51ea682505a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:08:59.936700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e81314780b46c8bdf5a577ca957827)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.940372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.955897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1082/2130] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:59 2022] DELETE /identity/v3/users/b160372a2c294c6d921c51ea682505a3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:08:59.960358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:59.960657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:59.961117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:00.006697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:00.007960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:00.054484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:00.056656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e81314780b46c8bdf5a577ca957827'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:00.072605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e81314780b46c8bdf5a577ca957827'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:00.074977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e81314780b46c8bdf5a577ca957827'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:00.083404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e81314780b46c8bdf5a577ca957827'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:00.106726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b59c3805-a3f3-4279-a403-4ebe0aaec79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e81314780b46c8bdf5a577ca957827'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:00.112454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1083/2131] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:00.123506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:00.125945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:00.134564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1049/2132] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:08:59 2022] DELETE /identity/v3/users/c8e81314780b46c8bdf5a577ca957827 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:00.139299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e649-a337-4064-9d24-78b547d1a10f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:00.140103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e649-a337-4064-9d24-78b547d1a10f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:00.140556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e649-a337-4064-9d24-78b547d1a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:00.163069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6b56e649-a337-4064-9d24-78b547d1a10f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:00.164526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6b56e649-a337-4064-9d24-78b547d1a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:00.196777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85f998-f6e9-4f03-8e28-c933b742ca4d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:00.219282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:00.238525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1050/2133] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:00.248345 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e649-a337-4064-9d24-78b547d1a10f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:00.257227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:00.258328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:00.259333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:00.259752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:00.280187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:00.282730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:00.299051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1084/2134] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:00.323832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e649-a337-4064-9d24-78b547d1a10f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:00.335077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:00.336037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:00.336523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:00.337026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:00.353079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:00.356258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:00.368254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1051/2135] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:00.986164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:00.987666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.008014 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40f39a-f613-4e4a-a2ec-73330d48b1e3 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.032851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.034360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.034851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.035264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] PATH_INFO: `/v3/projects/64ede9ea27844a368f2933ce2b5a3da6` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.037581 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ede9ea27844a368f2933ce2b5a3da6)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.041086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.099157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.100399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.131149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1e229-a71d-412f-ab1a-989055bac3ee service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.146648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.148663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.149019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.151547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] PATH_INFO: `/v3/projects/449a1305deb342cf82673821b10fb9d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.156899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449a1305deb342cf82673821b10fb9d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.168956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.178719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ede9ea27844a368f2933ce2b5a3da6', 'request_id': 'req-9d7d7587-b533-4176-a26c-b8afec7c947b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.188956 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ede9ea27844a368f2933ce2b5a3da6', 'request_id': 'req-9d7d7587-b533-4176-a26c-b8afec7c947b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.210106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ede9ea27844a368f2933ce2b5a3da6', 'request_id': 'req-9d7d7587-b533-4176-a26c-b8afec7c947b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.236848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] The token cache is being invalidate because project 64ede9ea27844a368f2933ce2b5a3da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:01.239501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.240184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449a1305deb342cf82673821b10fb9d1', 'request_id': 'req-70360eb3-8744-4cb1-8522-f5315aba1e32'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.242913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9d7d7587-b533-4176-a26c-b8afec7c947b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.251173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1085/2136] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:00 2022] DELETE /identity/v3/projects/64ede9ea27844a368f2933ce2b5a3da6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:01.254682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449a1305deb342cf82673821b10fb9d1', 'request_id': 'req-70360eb3-8744-4cb1-8522-f5315aba1e32'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.259111 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de522-0206-48aa-95f6-4a8a7d9e420b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.262444 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de522-0206-48aa-95f6-4a8a7d9e420b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.263107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de522-0206-48aa-95f6-4a8a7d9e420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.271706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449a1305deb342cf82673821b10fb9d1', 'request_id': 'req-70360eb3-8744-4cb1-8522-f5315aba1e32'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.286172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] The token cache is being invalidate because project 449a1305deb342cf82673821b10fb9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:01.286456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.287214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.292619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1052/2137] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:01 2022] DELETE /identity/v3/projects/449a1305deb342cf82673821b10fb9d1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:01.293614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.295127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.298966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7b4de522-0206-48aa-95f6-4a8a7d9e420b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:01.300298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7b4de522-0206-48aa-95f6-4a8a7d9e420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.331373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:01.416723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1086/2138] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:01.425621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c467b-0398-4a08-8556-c81d62c51dee None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.426054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c467b-0398-4a08-8556-c81d62c51dee None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.426440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c467b-0398-4a08-8556-c81d62c51dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.465323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-262c467b-0398-4a08-8556-c81d62c51dee None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:01.469584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-262c467b-0398-4a08-8556-c81d62c51dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.476007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360eb3-8744-4cb1-8522-f5315aba1e32 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.480147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1087/2139] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:01.484736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c467b-0398-4a08-8556-c81d62c51dee None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.490929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.492237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.492237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.492459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] PATH_INFO: `/v3/users/879cc38406564735921997dbe6857fb6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.498138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879cc38406564735921997dbe6857fb6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.500162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.502668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c467b-0398-4a08-8556-c81d62c51dee None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.518209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.520857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.522358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.526179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.529742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:01.530163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:09:01.531577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.536219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.564515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1088/2140] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:09:01.568558 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.591471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879cc38406564735921997dbe6857fb6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.594566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fff3-10d9-4e17-8d79-51ae5d751c41 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.603200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.604098 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.604460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.604797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.605010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879cc38406564735921997dbe6857fb6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.606262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.608267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.608419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879cc38406564735921997dbe6857fb6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.609026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879cc38406564735921997dbe6857fb6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.638953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879cc38406564735921997dbe6857fb6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:01.641303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1089/2141] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:01 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:01.645059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.647900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.663706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1053/2142] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:01 2022] DELETE /identity/v3/users/879cc38406564735921997dbe6857fb6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:01.729907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528ce42-7051-4c9f-868e-e33da7d79403 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.799058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.799787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.800075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.800501 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.801507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.803889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.871628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1090/2143] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:01 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:01.873658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.890783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e1895-4b46-4e19-a06d-7bafa6fdd470 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.897619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.898772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.899282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.899603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.900443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.902122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.914054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1054/2144] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:01.918260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.942688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88eaf4-7e44-4542-9192-825bab292761 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.943426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.944393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.944676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.944952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.946738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:01.948973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:01.963413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1091/2145] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:09:01.967657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.979365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f49ca-5440-4fd8-a646-636201ee130e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.984477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17ed54-d201-4b4c-a274-7224ae26305a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:01.985447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ed54-d201-4b4c-a274-7224ae26305a admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.985732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ed54-d201-4b4c-a274-7224ae26305a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.986007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ed54-d201-4b4c-a274-7224ae26305a admin admin] PATH_INFO: `/v3/projects/8b37237043d6462ea9fc82156548177a/users/0a9dd59dc68f467bb90c2fa74f1ff188/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.005647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17ed54-d201-4b4c-a274-7224ae26305a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b37237043d6462ea9fc82156548177a, user_id=0a9dd59dc68f467bb90c2fa74f1ff188, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.011401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17ed54-d201-4b4c-a274-7224ae26305a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.012524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.015247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.030017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:02.042705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1055/2146] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:01 2022] PUT /identity/v3/projects/8b37237043d6462ea9fc82156548177a/users/0a9dd59dc68f467bb90c2fa74f1ff188/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:02.043973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07e642-14f3-41b7-99c9-d7b0a2ffc157 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.053126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244672a6-0ed2-4500-b29d-1c2166bbdeaf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.053455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244672a6-0ed2-4500-b29d-1c2166bbdeaf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.053731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244672a6-0ed2-4500-b29d-1c2166bbdeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.092399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-244672a6-0ed2-4500-b29d-1c2166bbdeaf None None] MFA Rules not processed for user `0a9dd59dc68f467bb90c2fa74f1ff188`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:02.093740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-244672a6-0ed2-4500-b29d-1c2166bbdeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.134798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.136071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.136432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.136783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] PATH_INFO: `/v3/projects/fc52c7c5b01d46a68060115f521ab22f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.138234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc52c7c5b01d46a68060115f521ab22f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.140286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.205804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc52c7c5b01d46a68060115f521ab22f', 'request_id': 'req-4622f68e-3d08-4767-a661-65a987ba4953'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:02.213003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc52c7c5b01d46a68060115f521ab22f', 'request_id': 'req-4622f68e-3d08-4767-a661-65a987ba4953'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:02.217175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1056/2147] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:02.222179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244672a6-0ed2-4500-b29d-1c2166bbdeaf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.228054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc52c7c5b01d46a68060115f521ab22f', 'request_id': 'req-4622f68e-3d08-4767-a661-65a987ba4953'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:02.237539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244672a6-0ed2-4500-b29d-1c2166bbdeaf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.262908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] The token cache is being invalidate because project fc52c7c5b01d46a68060115f521ab22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:02.263101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:02.263798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4622f68e-3d08-4767-a661-65a987ba4953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:02.265502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1092/2148] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:02 2022] DELETE /identity/v3/projects/fc52c7c5b01d46a68060115f521ab22f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:02.271107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e49a-71e9-41b0-80bf-35df37417948 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.271529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e49a-71e9-41b0-80bf-35df37417948 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.271809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3e49a-71e9-41b0-80bf-35df37417948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.292449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cde3e49a-71e9-41b0-80bf-35df37417948 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:02.293898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cde3e49a-71e9-41b0-80bf-35df37417948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.310657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:02.327132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.327899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.328679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.328889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.329644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.332078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.362734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1057/2149] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:02.366548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1093/2150] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:02.366793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.368708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.374588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1bef-079d-45ce-9082-c4ea2e26f9a7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.375233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1bef-079d-45ce-9082-c4ea2e26f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.375460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1bef-079d-45ce-9082-c4ea2e26f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.397214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e55b1bef-079d-45ce-9082-c4ea2e26f9a7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:02.398470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e55b1bef-079d-45ce-9082-c4ea2e26f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.436421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:02.443874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfffb6-c69c-4ef4-9f64-2cd81178c3d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.449615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.450105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.450390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.450683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.451380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.453467 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.483328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1058/2151] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:02.483672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1094/2152] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:02.487247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.487566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b1bef-079d-45ce-9082-c4ea2e26f9a7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.498411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac900a-5898-4af0-a65a-c475476c713f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.499525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b1bef-079d-45ce-9082-c4ea2e26f9a7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.503288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.503964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.504247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.504372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.504631 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.505173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.505456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.505564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.505783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.506520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:09:02.506851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.507105 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.509101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.523989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1059/2153] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:09:02.524686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1095/2154] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:09:02.525686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.528315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.536884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cf1bf-0ed7-448f-9c1a-e04c05cd50b0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.540723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ae3a-03ae-4e5f-b4ed-801f915730f7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.542430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.543348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.543678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.543890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] PATH_INFO: `/v3/projects/b0baaee148284ce8870000b623fc4a7c/users/d423ce6dd9f74b1ea0a764c598da62e4/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.545718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.546628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.546904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.548088 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.548786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.550805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.563454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0baaee148284ce8870000b623fc4a7c, user_id=d423ce6dd9f74b1ea0a764c598da62e4, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.566501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.580476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1096/2155] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:02.584711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.585272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1060/2156] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:02 2022] PUT /identity/v3/projects/b0baaee148284ce8870000b623fc4a7c/users/d423ce6dd9f74b1ea0a764c598da62e4/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:02.589639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.666024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406a0bc-97ac-469f-854f-6c8f31b14e80 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.676053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.677094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.677295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.677701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.678596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.680824 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.687435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b02af-3959-4ce7-b27a-20689e5e16f9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.694112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.695130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.695415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.696447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.697080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.698971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.704681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1097/2157] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:02.708968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.716447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1061/2158] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:02.720216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.730290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fdd83-408f-4ac8-bbb3-3a9f52933613 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.731301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24539b90-8425-48bf-a8a6-487e92911bfa admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.738961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341f11e-61d6-4e00-9cec-d89fcb8bcb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.739878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f11e-61d6-4e00-9cec-d89fcb8bcb3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.740166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f11e-61d6-4e00-9cec-d89fcb8bcb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.740450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f11e-61d6-4e00-9cec-d89fcb8bcb3d admin admin] PATH_INFO: `/v3/projects/b0baaee148284ce8870000b623fc4a7c/users/d423ce6dd9f74b1ea0a764c598da62e4/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.741952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.742734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.743067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.743360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.744107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.745815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.748626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341f11e-61d6-4e00-9cec-d89fcb8bcb3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0baaee148284ce8870000b623fc4a7c, user_id=d423ce6dd9f74b1ea0a764c598da62e4, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.751356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341f11e-61d6-4e00-9cec-d89fcb8bcb3d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.760448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1098/2159] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:09:02.764069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.766339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1062/2160] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:02 2022] PUT /identity/v3/projects/b0baaee148284ce8870000b623fc4a7c/users/d423ce6dd9f74b1ea0a764c598da62e4/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:09:02.779940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.779940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.779940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.784537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db1f82-0e45-498c-a581-9d646a1ad2a2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.803670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:02.822838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] MFA Rules not processed for user `d423ce6dd9f74b1ea0a764c598da62e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:02.827045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.920541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.921263 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.923295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.923579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.924795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.926574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.940647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1099/2161] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:02.945561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.958594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e256c-d1e2-4312-85e8-247a18ab1187 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:02.965384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ab4ef-5810-49d9-86f5-d5eca782cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.966380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab4ef-5810-49d9-86f5-d5eca782cf5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.966660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab4ef-5810-49d9-86f5-d5eca782cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.966946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab4ef-5810-49d9-86f5-d5eca782cf5f admin admin] PATH_INFO: `/v3/projects/9a6c9a8906cb435dbd559571e65ddf92/users/dab2070fb2b54589a4c8bc2d3407cd94/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.971130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1063/2162] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:02.981465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:02.981865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:02.986554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ab4ef-5810-49d9-86f5-d5eca782cf5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6c9a8906cb435dbd559571e65ddf92, user_id=dab2070fb2b54589a4c8bc2d3407cd94, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.987148 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.990051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ab4ef-5810-49d9-86f5-d5eca782cf5f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.024968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1100/2163] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:02 2022] PUT /identity/v3/projects/9a6c9a8906cb435dbd559571e65ddf92/users/dab2070fb2b54589a4c8bc2d3407cd94/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:03.035433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547aa87-28e2-450b-8259-bc34f2700932 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.036469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547aa87-28e2-450b-8259-bc34f2700932 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.036777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547aa87-28e2-450b-8259-bc34f2700932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.094504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691280c-fb2e-41d5-9cd0-32f2a692d5fc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.098276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7547aa87-28e2-450b-8259-bc34f2700932 None None] MFA Rules not processed for user `dab2070fb2b54589a4c8bc2d3407cd94`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:03.099878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7547aa87-28e2-450b-8259-bc34f2700932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:03.151427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.152049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.152433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.152739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.154778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:03.176191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1101/2164] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:03.182093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547aa87-28e2-450b-8259-bc34f2700932 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:03.253684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.255200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.273497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1064/2165] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:03.275496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547aa87-28e2-450b-8259-bc34f2700932 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.281606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.282279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.282566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.282845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.283544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.285793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.362717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1102/2166] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:03 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:03.366760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:03.381646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a214-dffa-44be-b01b-5638b9c1a9d2 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.391676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:03.471245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.471929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.472214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.472488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.473182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.475149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.498712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1065/2167] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:03 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:03.500007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:03.511260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610bfb3-8348-4177-b110-b358ef520889 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.516789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.517531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.517848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.518161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.519179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.520884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.537507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1103/2168] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:03.541795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:03.552581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb7351-8f4d-4377-9170-40c7d9dccdc0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.557929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.558890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.559177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.559462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] PATH_INFO: `/v3/projects/32c696fbb73a4d8dac878db4617a2bba/users/cc222d8d58eb47269117c21865cd00f6/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.575956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c696fbb73a4d8dac878db4617a2bba, user_id=cc222d8d58eb47269117c21865cd00f6, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.578662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.593548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1066/2169] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:03 2022] PUT /identity/v3/projects/32c696fbb73a4d8dac878db4617a2bba/users/cc222d8d58eb47269117c21865cd00f6/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:03.597583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:03.609291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80b946-2ecb-4c8d-8a73-1d7161cd802b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.686476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:03.695078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab126a03-affa-4d0b-8af0-30c786df9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.696739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126a03-affa-4d0b-8af0-30c786df9d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.697223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126a03-affa-4d0b-8af0-30c786df9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.697547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab126a03-affa-4d0b-8af0-30c786df9d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.698289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab126a03-affa-4d0b-8af0-30c786df9d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.699907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab126a03-affa-4d0b-8af0-30c786df9d99 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.710177 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1104/2170] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:03.714486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:03.724943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c2981-ef00-4234-a089-de36ea8a6ae2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.729868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.730742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.731026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.731305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] PATH_INFO: `/v3/projects/32c696fbb73a4d8dac878db4617a2bba/users/cc222d8d58eb47269117c21865cd00f6/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.733293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c696fbb73a4d8dac878db4617a2bba, user_id=cc222d8d58eb47269117c21865cd00f6, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.736194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.747257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1067/2171] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:03 2022] PUT /identity/v3/projects/32c696fbb73a4d8dac878db4617a2bba/users/cc222d8d58eb47269117c21865cd00f6/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:09:03.759051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d537f8-77b5-40e5-9f70-8cc0a51fecb4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.759341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d537f8-77b5-40e5-9f70-8cc0a51fecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.759635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d537f8-77b5-40e5-9f70-8cc0a51fecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.785798 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a6d537f8-77b5-40e5-9f70-8cc0a51fecb4 None None] MFA Rules not processed for user `cc222d8d58eb47269117c21865cd00f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:03.787570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a6d537f8-77b5-40e5-9f70-8cc0a51fecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:03.855836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1105/2172] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:03.867339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:03.928320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bfa46-1271-47a0-963e-caf145f3dfc8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:03.932970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:03.933651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:03.933931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:03.934204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:03.943899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:03.945323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:03.955306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1068/2173] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:04.028153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d537f8-77b5-40e5-9f70-8cc0a51fecb4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:04.038002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d537f8-77b5-40e5-9f70-8cc0a51fecb4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:04.042533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10db26-1548-47d9-949d-0eb0fd28bae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:04.045985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10db26-1548-47d9-949d-0eb0fd28bae3 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:04.046365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10db26-1548-47d9-949d-0eb0fd28bae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:04.046711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10db26-1548-47d9-949d-0eb0fd28bae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:04.113516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10db26-1548-47d9-949d-0eb0fd28bae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:04.115245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10db26-1548-47d9-949d-0eb0fd28bae3 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:04.125774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1106/2174] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:08.108059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:08.174584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18389f8-3dd1-4161-b941-8dcdf82cd8c5 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:08.179211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:08.184249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:08.184589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:08.184809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] PATH_INFO: `/v3/users/0a9dd59dc68f467bb90c2fa74f1ff188` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:08.186089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9dd59dc68f467bb90c2fa74f1ff188)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:08.188183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:08.191538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:08.245074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9dd59dc68f467bb90c2fa74f1ff188'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.254546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9dd59dc68f467bb90c2fa74f1ff188'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.255155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9dd59dc68f467bb90c2fa74f1ff188'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.255795 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9dd59dc68f467bb90c2fa74f1ff188'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.265023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9dd59dc68f467bb90c2fa74f1ff188'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.284570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1069/2175] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:08 2022] DELETE /identity/v3/users/0a9dd59dc68f467bb90c2fa74f1ff188 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:08.289275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:08.289761 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:08.289997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:08.308253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:08.309517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:08.368039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1107/2176] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:08.377776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:08.379191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:08.438518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327622e6-38ca-4a4b-904a-f72850895b0c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:08.442547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:08.443273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:08.443696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:08.443855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:08.454665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:08.456133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:08.467285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1070/2177] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:08.786702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:08.788428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:08.808289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f476cce-0a22-447f-b9f3-30fc9f761dbb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:08.813970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:08.815336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:08.815625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:08.816195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] PATH_INFO: `/v3/projects/8b37237043d6462ea9fc82156548177a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:08.819420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b37237043d6462ea9fc82156548177a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:08.822268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:08.850954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:08.900283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b37237043d6462ea9fc82156548177a', 'request_id': 'req-a7718409-6a73-4996-9414-c425f5575bcb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.913626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b37237043d6462ea9fc82156548177a', 'request_id': 'req-a7718409-6a73-4996-9414-c425f5575bcb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.924888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b37237043d6462ea9fc82156548177a', 'request_id': 'req-a7718409-6a73-4996-9414-c425f5575bcb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.938038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] The token cache is being invalidate because project 8b37237043d6462ea9fc82156548177a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:08.938308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.938945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:08.940717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1108/2178] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:08 2022] DELETE /identity/v3/projects/8b37237043d6462ea9fc82156548177a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:08.947043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:08.967767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b1fb-9016-4f9e-b0ad-c4b015755c7d service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:09.059254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:09.060208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:09.060493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:09.060775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] PATH_INFO: `/v3/users/d423ce6dd9f74b1ea0a764c598da62e4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:09.062025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d423ce6dd9f74b1ea0a764c598da62e4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:09.063981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:09.101060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:09.123621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd423ce6dd9f74b1ea0a764c598da62e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.131343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd423ce6dd9f74b1ea0a764c598da62e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.132067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd423ce6dd9f74b1ea0a764c598da62e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.132718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd423ce6dd9f74b1ea0a764c598da62e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.140884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd423ce6dd9f74b1ea0a764c598da62e4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.158496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1071/2179] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:08 2022] DELETE /identity/v3/users/d423ce6dd9f74b1ea0a764c598da62e4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:09:09.454390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:09.456385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:09.475836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7718409-6a73-4996-9414-c425f5575bcb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:09.536026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:09.536887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:09.537172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:09.537488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] PATH_INFO: `/v3/projects/b0baaee148284ce8870000b623fc4a7c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:09.538688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0baaee148284ce8870000b623fc4a7c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:09.541558 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:09.589671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0baaee148284ce8870000b623fc4a7c', 'request_id': 'req-cc7cca64-7d44-473e-a30f-074381aecab3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.595517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0baaee148284ce8870000b623fc4a7c', 'request_id': 'req-cc7cca64-7d44-473e-a30f-074381aecab3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.603743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0baaee148284ce8870000b623fc4a7c', 'request_id': 'req-cc7cca64-7d44-473e-a30f-074381aecab3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.615248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] The token cache is being invalidate because project b0baaee148284ce8870000b623fc4a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:09.615506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.616071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-cc7cca64-7d44-473e-a30f-074381aecab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:09.617853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1109/2180] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:09 2022] DELETE /identity/v3/projects/b0baaee148284ce8870000b623fc4a7c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:11.779385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:11.781264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:11.798858 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea66f2f-526c-4e35-9276-9616beeb2799 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:11.891304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:11.892593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:11.892885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:11.902104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] PATH_INFO: `/v3/users/dab2070fb2b54589a4c8bc2d3407cd94` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:11.906260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab2070fb2b54589a4c8bc2d3407cd94)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:11.908943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:11.982918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab2070fb2b54589a4c8bc2d3407cd94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.010438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab2070fb2b54589a4c8bc2d3407cd94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.012097 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab2070fb2b54589a4c8bc2d3407cd94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.015295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab2070fb2b54589a4c8bc2d3407cd94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.028030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab2070fb2b54589a4c8bc2d3407cd94'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.051361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1072/2181] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:11 2022] DELETE /identity/v3/users/dab2070fb2b54589a4c8bc2d3407cd94 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:12.059418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:12.064940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:12.065296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:12.092084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:12.094424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:12.133779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:12.172246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1110/2182] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:12.182313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:12.183846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:12.211850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:12.247717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89923259-6bd0-4d7e-af4f-2cd8a08bfcd1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:12.251385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:12.252036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:12.252321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:12.252606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:12.262914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:12.264371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:12.276291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1073/2183] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:12.691746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:12.693319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:12.707094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4bf99-61dc-499e-b47f-10db418ed149 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:12.712087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:12.713002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:12.713286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:12.713599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] PATH_INFO: `/v3/projects/9a6c9a8906cb435dbd559571e65ddf92` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:12.714814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6c9a8906cb435dbd559571e65ddf92)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:12.716754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:12.767033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6c9a8906cb435dbd559571e65ddf92', 'request_id': 'req-836ec827-e975-4f6c-a9e8-4cfbbabe602b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.775322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6c9a8906cb435dbd559571e65ddf92', 'request_id': 'req-836ec827-e975-4f6c-a9e8-4cfbbabe602b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.783123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6c9a8906cb435dbd559571e65ddf92', 'request_id': 'req-836ec827-e975-4f6c-a9e8-4cfbbabe602b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.802425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] The token cache is being invalidate because project 9a6c9a8906cb435dbd559571e65ddf92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:12.802718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.803382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.805601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1111/2184] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:12 2022] DELETE /identity/v3/projects/9a6c9a8906cb435dbd559571e65ddf92 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:12.809591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:12.819698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaeb1f-4292-4d5b-a806-895f4a101e7d service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:12.885152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:12.885152 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:12.885420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:12.885790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] PATH_INFO: `/v3/users/cc222d8d58eb47269117c21865cd00f6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:12.886862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc222d8d58eb47269117c21865cd00f6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:12.889223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:12.951359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc222d8d58eb47269117c21865cd00f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.958669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc222d8d58eb47269117c21865cd00f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.959340 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc222d8d58eb47269117c21865cd00f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.960082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc222d8d58eb47269117c21865cd00f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.968291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69b265e6-7800-49d6-b5ec-a97f778c726d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc222d8d58eb47269117c21865cd00f6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:12.991574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1074/2185] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:12 2022] DELETE /identity/v3/users/cc222d8d58eb47269117c21865cd00f6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:13.292156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:13.293938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:13.308029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ec827-e975-4f6c-a9e8-4cfbbabe602b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:13.384292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:13.385159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.385464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.385740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] PATH_INFO: `/v3/projects/32c696fbb73a4d8dac878db4617a2bba` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.386921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c696fbb73a4d8dac878db4617a2bba)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:13.388807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:13.437967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c696fbb73a4d8dac878db4617a2bba', 'request_id': 'req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:13.442226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:13.444750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c696fbb73a4d8dac878db4617a2bba', 'request_id': 'req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:13.454748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c696fbb73a4d8dac878db4617a2bba', 'request_id': 'req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:13.468404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] The token cache is being invalidate because project 32c696fbb73a4d8dac878db4617a2bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:13.468696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:13.469369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-84aab6d3-14c2-44b1-8c14-16e0cbd8eaf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:13.470897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1112/2186] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:13 2022] DELETE /identity/v3/projects/32c696fbb73a4d8dac878db4617a2bba => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:13.475900 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4a5a-414a-47f7-a96c-625cb8eb3ba2 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.476810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4a5a-414a-47f7-a96c-625cb8eb3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.477374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f4a5a-414a-47f7-a96c-625cb8eb3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.496119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db5f4a5a-414a-47f7-a96c-625cb8eb3ba2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:13.497466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db5f4a5a-414a-47f7-a96c-625cb8eb3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:13.544965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:13.566145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1075/2187] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:13.575323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c6af-f793-4815-8516-0c017ece3169 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.575638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c6af-f793-4815-8516-0c017ece3169 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.575998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633c6af-f793-4815-8516-0c017ece3169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.594944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f633c6af-f793-4815-8516-0c017ece3169 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:13.596171 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f633c6af-f793-4815-8516-0c017ece3169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:13.605489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1113/2188] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:13.609415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4a5a-414a-47f7-a96c-625cb8eb3ba2 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:13.619821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f4a5a-414a-47f7-a96c-625cb8eb3ba2 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:13.624439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:13.625098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.627053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.627053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.627053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:09:13.627053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:13.628494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:13.640776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1076/2189] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:09:13.645236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c6af-f793-4815-8516-0c017ece3169 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:13.659353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633c6af-f793-4815-8516-0c017ece3169 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:13.665108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:13.665998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.666414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.666762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.667532 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:13.669476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:13.700247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1114/2190] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:13.701461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:13.711865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ac916-7fb8-4349-8404-a37f968f1c60 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:13.769984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:13.770677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.770978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.771252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.771938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:13.774146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:13.793459 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1077/2191] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:13 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:13.797635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:13.808706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544d2fd-edbd-4345-9cb4-4f29c71c7ab6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:13.813420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:13.814078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.814360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.814633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.815362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:13.817227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:13.828296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1115/2192] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:13.832336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:13.843247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301a36-4a24-4dbd-b476-a602a0ecc965 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:13.847853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132a79e-ad81-46f8-8b2c-c03de3288ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:13.848508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a79e-ad81-46f8-8b2c-c03de3288ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.848822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a79e-ad81-46f8-8b2c-c03de3288ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.849099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132a79e-ad81-46f8-8b2c-c03de3288ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.849865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132a79e-ad81-46f8-8b2c-c03de3288ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:13.852127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132a79e-ad81-46f8-8b2c-c03de3288ae9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:13.862332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1078/2193] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:09:13.866455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:13.878475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e07e76-3e0b-470e-8430-75aed8d4e0b7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:13.884147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:13.885147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.885482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.885760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] PATH_INFO: `/v3/projects/8ad727bc54734e0ea21825b7c8cda82a/users/9246fac930804341bab7520b4c6b9d02/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.901647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad727bc54734e0ea21825b7c8cda82a, user_id=9246fac930804341bab7520b4c6b9d02, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:13.904246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:13.918238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1116/2194] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:13 2022] PUT /identity/v3/projects/8ad727bc54734e0ea21825b7c8cda82a/users/9246fac930804341bab7520b4c6b9d02/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:13.923583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6559d3-ccdc-4240-9ff6-74c4a75fddac None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.923948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6559d3-ccdc-4240-9ff6-74c4a75fddac None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.924277 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6559d3-ccdc-4240-9ff6-74c4a75fddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.943293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1f6559d3-ccdc-4240-9ff6-74c4a75fddac None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:13.944502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1f6559d3-ccdc-4240-9ff6-74c4a75fddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:14.007429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1079/2195] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:14.017049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:14.018794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:14.076707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcde42-8ef5-46dc-97d0-ed8af6675ab6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:14.080597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:14.081244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:14.081614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:14.081841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:14.093486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:14.094936 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:14.106638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1117/2196] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:14.845336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926b41-fdb4-49df-9dea-09e914e39103 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:14.845826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926b41-fdb4-49df-9dea-09e914e39103 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:14.845905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae926b41-fdb4-49df-9dea-09e914e39103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:14.877034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ae926b41-fdb4-49df-9dea-09e914e39103 None None] MFA Rules not processed for user `9246fac930804341bab7520b4c6b9d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:14.878873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ae926b41-fdb4-49df-9dea-09e914e39103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:14.931915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:14.978687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1080/2197] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:14.980594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:14.991682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cc477-4008-4b8f-9cbe-aaca850ccbf9 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:15.000972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:15.002155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:15.002453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:15.002803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:15.003585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:15.006015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:15.046660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1118/2198] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:14 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:15.050798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926b41-fdb4-49df-9dea-09e914e39103 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:15.074681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae926b41-fdb4-49df-9dea-09e914e39103 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:15.164013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:15.164701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:15.164991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:15.165273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:15.166061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:15.168008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:15.196419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1081/2199] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:15 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:15.200148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:15.212460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd306f-8ae4-470e-a399-0abc6da2d5a0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:15.217788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:15.218737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:15.219226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:15.219711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:15.220649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:15.223355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:15.236091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1119/2200] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:15.240198 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:15.252767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91c1f-7bdf-4a3d-980c-cc67d326acc7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:15.259010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:15.260298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:15.260671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:15.261802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] PATH_INFO: `/v3/projects/945cf1ee02124324be8afd432fef3e3b/users/b93428c805ef45ada4ad8a287435e412/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:15.287991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=945cf1ee02124324be8afd432fef3e3b, user_id=b93428c805ef45ada4ad8a287435e412, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:15.291242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:15.307725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1082/2201] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:15 2022] PUT /identity/v3/projects/945cf1ee02124324be8afd432fef3e3b/users/b93428c805ef45ada4ad8a287435e412/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:09:15.311726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:15.323180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a46a-d235-4dba-9fa4-bd7b98515c5d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:15.374746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:15.390172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3e07b-36ab-4632-a81e-d64becda314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:15.390864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e07b-36ab-4632-a81e-d64becda314e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:15.391146 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e07b-36ab-4632-a81e-d64becda314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:15.391419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3e07b-36ab-4632-a81e-d64becda314e admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:15.392157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3e07b-36ab-4632-a81e-d64becda314e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:15.393841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3e07b-36ab-4632-a81e-d64becda314e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:15.406253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1120/2202] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:09:15.410854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:15.424712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28047aa5-115e-4557-b65f-566e19cffd0b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:15.429751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669d8cc-5c1e-4195-9d41-f569353b7eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:15.430751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669d8cc-5c1e-4195-9d41-f569353b7eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:15.431036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669d8cc-5c1e-4195-9d41-f569353b7eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:15.431312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669d8cc-5c1e-4195-9d41-f569353b7eaa admin admin] PATH_INFO: `/v3/projects/945cf1ee02124324be8afd432fef3e3b/users/b93428c805ef45ada4ad8a287435e412/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:15.433363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669d8cc-5c1e-4195-9d41-f569353b7eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=945cf1ee02124324be8afd432fef3e3b, user_id=b93428c805ef45ada4ad8a287435e412, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:15.436293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669d8cc-5c1e-4195-9d41-f569353b7eaa admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:15.448443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1083/2203] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:15 2022] PUT /identity/v3/projects/945cf1ee02124324be8afd432fef3e3b/users/b93428c805ef45ada4ad8a287435e412/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:16.150481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:16.152653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:16.155277 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:16.187877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] MFA Rules not processed for user `b93428c805ef45ada4ad8a287435e412`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:16.189890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:16.295208 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1121/2204] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:16.306550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:16.307030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:16.307109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:16.325984 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] MFA Rules not processed for user `9246fac930804341bab7520b4c6b9d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:16.327194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:16.398534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1084/2205] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:16.409600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:16.411096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:16.500366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af81a0-64cd-4556-9de2-83dd1827de64 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:16.506312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:16.506970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:16.507332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:16.508201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:16.517210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:16.518966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:16.530132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1122/2206] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:18.964574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:18.966476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:19.016247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:19.041215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36416b5e-f1b6-4de9-a3f9-9bb8d2f3c28c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.045786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.046659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.046945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.047429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] PATH_INFO: `/v3/users/371340721cfc4b778ec39ccc167172e5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.048635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371340721cfc4b778ec39ccc167172e5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.050617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.107110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371340721cfc4b778ec39ccc167172e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.114683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371340721cfc4b778ec39ccc167172e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.115331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371340721cfc4b778ec39ccc167172e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.115909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371340721cfc4b778ec39ccc167172e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.124319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a91e21b-489f-4a3d-8602-dbe651a4b0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371340721cfc4b778ec39ccc167172e5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.142670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1085/2207] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:18 2022] DELETE /identity/v3/users/371340721cfc4b778ec39ccc167172e5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:19.329733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.341634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5000e00e-cfbc-4247-91d3-0dedcdcd7a15 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.400481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:19.408753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.409654 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.409932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.410204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] PATH_INFO: `/v3/projects/7d82b1caebf34cbdb6c4cfeeaa30ce7d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.411439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d82b1caebf34cbdb6c4cfeeaa30ce7d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.413522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.463031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d82b1caebf34cbdb6c4cfeeaa30ce7d', 'request_id': 'req-d106d20f-b4fc-4460-a4d4-f55871ace757'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.469209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d82b1caebf34cbdb6c4cfeeaa30ce7d', 'request_id': 'req-d106d20f-b4fc-4460-a4d4-f55871ace757'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.478533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d82b1caebf34cbdb6c4cfeeaa30ce7d', 'request_id': 'req-d106d20f-b4fc-4460-a4d4-f55871ace757'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.490759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] The token cache is being invalidate because project 7d82b1caebf34cbdb6c4cfeeaa30ce7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:19.491047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.493142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-d106d20f-b4fc-4460-a4d4-f55871ace757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:19.495067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1123/2208] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:19 2022] DELETE /identity/v3/projects/7d82b1caebf34cbdb6c4cfeeaa30ce7d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:19.500291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987f9b-4733-4b95-8ca6-322bfc7e7a68 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.500683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987f9b-4733-4b95-8ca6-322bfc7e7a68 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.501021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c987f9b-4733-4b95-8ca6-322bfc7e7a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.519840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4c987f9b-4733-4b95-8ca6-322bfc7e7a68 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:19.521215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4c987f9b-4733-4b95-8ca6-322bfc7e7a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:19.582206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1086/2209] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:19.591201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57ee1-5202-4cfd-9e80-fcc1ebef2469 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.591687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57ee1-5202-4cfd-9e80-fcc1ebef2469 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.591971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade57ee1-5202-4cfd-9e80-fcc1ebef2469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.611557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ade57ee1-5202-4cfd-9e80-fcc1ebef2469 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:19.612755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ade57ee1-5202-4cfd-9e80-fcc1ebef2469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:19.621333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1124/2210] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:19.625715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c987f9b-4733-4b95-8ca6-322bfc7e7a68 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.639360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c987f9b-4733-4b95-8ca6-322bfc7e7a68 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.644077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.644781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.645086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.645478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.646245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:09:19.646617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.648929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.665811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1087/2211] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:09:19.670267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57ee1-5202-4cfd-9e80-fcc1ebef2469 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.684194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade57ee1-5202-4cfd-9e80-fcc1ebef2469 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.689255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.690022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.690351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.690898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.691606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.694257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.721884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1125/2212] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:19 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:19.725932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.737215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7f174-8ade-4d04-91ed-42b53b8c1fa1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.785005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:19.808208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.808927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.809230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.809535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.810246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.812192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.839313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1088/2213] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:19 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:19.844989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.856238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bab0d5-6dc6-4870-9522-5f003ab0a8f7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.860957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.861666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.861953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.862260 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.862968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.864609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.876603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1126/2214] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:19.880486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.891476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f2ea0-63c0-427f-adf0-8a51cad36c57 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.896377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937a171-34a6-45d1-b350-265f60d5a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.897059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a171-34a6-45d1-b350-265f60d5a903 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.897434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a171-34a6-45d1-b350-265f60d5a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.897717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937a171-34a6-45d1-b350-265f60d5a903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.899104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937a171-34a6-45d1-b350-265f60d5a903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.900728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937a171-34a6-45d1-b350-265f60d5a903 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.911196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1089/2215] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:19.916341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.926638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270935-f96e-40ea-9057-e3f820ce879f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.933042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.933977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.934261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.934533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] PATH_INFO: `/v3/projects/d9b4bce57b1c40ebaee6bdcb2ffc619a/users/7d9d976d8d324b53bcc2adc4c6d081e5/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.951205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b4bce57b1c40ebaee6bdcb2ffc619a, user_id=7d9d976d8d324b53bcc2adc4c6d081e5, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.953917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.967981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1127/2216] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:19 2022] PUT /identity/v3/projects/d9b4bce57b1c40ebaee6bdcb2ffc619a/users/7d9d976d8d324b53bcc2adc4c6d081e5/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:19.973024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb902-98f4-4958-9731-ae0c50b4de16 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.973532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb902-98f4-4958-9731-ae0c50b4de16 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.973682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fb902-98f4-4958-9731-ae0c50b4de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:20.000632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-098fb902-98f4-4958-9731-ae0c50b4de16 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:20.001918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-098fb902-98f4-4958-9731-ae0c50b4de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:20.070215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1090/2217] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:20.079828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:20.081841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:20.138504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609260b3-1ed8-4039-ba39-a164a1653a00 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:20.142169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:20.142815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:20.143104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:20.143382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:20.154121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:20.155576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:20.166343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1128/2218] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:24.652987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f739c5-5a48-4639-afcb-5bd966a59d9b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:24.653655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f739c5-5a48-4639-afcb-5bd966a59d9b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:24.653762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f739c5-5a48-4639-afcb-5bd966a59d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:24.693023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-08f739c5-5a48-4639-afcb-5bd966a59d9b None None] MFA Rules not processed for user `7d9d976d8d324b53bcc2adc4c6d081e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:24.694812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-08f739c5-5a48-4639-afcb-5bd966a59d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:24.814579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1091/2219] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:24.825120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:24.826687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:24.864434 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:24.925727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d195-f935-4f21-bed7-190707bb6017 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:24.932638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff14a9-2041-489e-ac4d-66facd0c116b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:24.933937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff14a9-2041-489e-ac4d-66facd0c116b service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:24.934228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff14a9-2041-489e-ac4d-66facd0c116b service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:24.934807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff14a9-2041-489e-ac4d-66facd0c116b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:24.954168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff14a9-2041-489e-ac4d-66facd0c116b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:24.955633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff14a9-2041-489e-ac4d-66facd0c116b service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:24.986431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1129/2220] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:25.127361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636874-4403-474c-9f41-0051551f123d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:25.127943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636874-4403-474c-9f41-0051551f123d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:25.128232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49636874-4403-474c-9f41-0051551f123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:25.150477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-49636874-4403-474c-9f41-0051551f123d None None] MFA Rules not processed for user `52490fb84bb343d9af6eeaae1dc50aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:25.151744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49636874-4403-474c-9f41-0051551f123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:25.225269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:25.241394 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1092/2221] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:26.673292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9ca1-19a7-4ffc-9f36-e924b0456805 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:26.673734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9ca1-19a7-4ffc-9f36-e924b0456805 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:26.674007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9ca1-19a7-4ffc-9f36-e924b0456805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:26.695436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5e4f9ca1-19a7-4ffc-9f36-e924b0456805 None None] MFA Rules not processed for user `7d9d976d8d324b53bcc2adc4c6d081e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:26.697725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5e4f9ca1-19a7-4ffc-9f36-e924b0456805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:26.708280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1130/2222] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:35.239061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:36.686955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=26 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:53.601586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49636874-4403-474c-9f41-0051551f123d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:53.603186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49636874-4403-474c-9f41-0051551f123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:53.618073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49636874-4403-474c-9f41-0051551f123d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:53.622485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:53.623348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:53.623627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:53.623953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] PATH_INFO: `/v3/users/90777774c21844dab08c524c5c203445` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:53.625220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90777774c21844dab08c524c5c203445)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:53.627250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:53.683586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90777774c21844dab08c524c5c203445'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:53.692158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90777774c21844dab08c524c5c203445'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:53.692988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90777774c21844dab08c524c5c203445'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:53.693693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90777774c21844dab08c524c5c203445'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:53.700989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90777774c21844dab08c524c5c203445'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:53.720587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1093/2223] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:53 2022] DELETE /identity/v3/users/90777774c21844dab08c524c5c203445 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:53.725841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:53.726300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:53.726396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:53.744118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:53.745385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:53.804310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1131/2224] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:53.814044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:53.815705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:53.878195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707094b-f4ed-421e-9c46-6d3c4dc495d0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:53.881854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:53.882540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:53.882826 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:53.883215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:53.892655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:53.895967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:53.905592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1094/2225] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:54.178183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.179771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:54.194904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443145b-f7a7-4d41-9cb3-9eeb73b1d2e4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.200425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.201661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.202446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.202974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] PATH_INFO: `/v3/users/f5ccb8fb73c74e50b462dd86593007a4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.204508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ccb8fb73c74e50b462dd86593007a4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.207155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:54.313686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ccb8fb73c74e50b462dd86593007a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.328843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ccb8fb73c74e50b462dd86593007a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.330375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ccb8fb73c74e50b462dd86593007a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.331512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.334228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:54.349058 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ccb8fb73c74e50b462dd86593007a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.350507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b0294e42-2219-4292-94e1-d75a9db5d4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ccb8fb73c74e50b462dd86593007a4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.358626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c69ad-a770-4c3a-95ce-8f8d7333688c service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.373975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.374862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.375150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.375429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] PATH_INFO: `/v3/projects/c84c4c6ca28f4393aa5aafda0ef1b72f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.376923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84c4c6ca28f4393aa5aafda0ef1b72f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.381563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1132/2226] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:54 2022] DELETE /identity/v3/users/f5ccb8fb73c74e50b462dd86593007a4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:54.382976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bff68-ca26-4416-9fc5-7eda5b96f1a6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.383266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bff68-ca26-4416-9fc5-7eda5b96f1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.383544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bff68-ca26-4416-9fc5-7eda5b96f1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.384931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:54.426518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c83bff68-ca26-4416-9fc5-7eda5b96f1a6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:54.427795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c83bff68-ca26-4416-9fc5-7eda5b96f1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:54.470570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84c4c6ca28f4393aa5aafda0ef1b72f', 'request_id': 'req-e2f6bd68-c509-405c-81c4-75357a7b47d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.479115 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84c4c6ca28f4393aa5aafda0ef1b72f', 'request_id': 'req-e2f6bd68-c509-405c-81c4-75357a7b47d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.485886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84c4c6ca28f4393aa5aafda0ef1b72f', 'request_id': 'req-e2f6bd68-c509-405c-81c4-75357a7b47d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.493583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:54.499150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] The token cache is being invalidate because project c84c4c6ca28f4393aa5aafda0ef1b72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:54.499454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1133/2227] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:54.499605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.500207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:54.502190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1095/2228] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:54 2022] DELETE /identity/v3/projects/c84c4c6ca28f4393aa5aafda0ef1b72f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:09:54.507374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dabca-2b60-4269-a748-60514a1ad871 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.507765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dabca-2b60-4269-a748-60514a1ad871 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.507947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dabca-2b60-4269-a748-60514a1ad871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.509629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.511271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:54.527085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a36dabca-2b60-4269-a748-60514a1ad871 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:54.528415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a36dabca-2b60-4269-a748-60514a1ad871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:54.538617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:54.571417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6bd68-c509-405c-81c4-75357a7b47d5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.575149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.575803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.576079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.576360 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.578191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:54.613512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1134/2229] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:54.615763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738635d-3296-4bcf-9e78-ab8a0b07d4f4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.616063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738635d-3296-4bcf-9e78-ab8a0b07d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.616483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738635d-3296-4bcf-9e78-ab8a0b07d4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.642409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4738635d-3296-4bcf-9e78-ab8a0b07d4f4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:54.643974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4738635d-3296-4bcf-9e78-ab8a0b07d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:54.655269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1135/2230] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:54.659698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738635d-3296-4bcf-9e78-ab8a0b07d4f4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.671626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738635d-3296-4bcf-9e78-ab8a0b07d4f4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.675944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.678006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.678788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.679057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:54.679267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.679636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.680518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:09:54.680921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.683775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:54.695267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1096/2231] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:54.697395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1136/2232] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:09:54.700463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.712217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033c3fd-66b4-4855-9a04-077a1633f6f4 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.717295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.718178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.718627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.719071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.719936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.722153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:54.753324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1097/2233] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:54 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:09:54.758529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.768993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bc6f5-fefd-4b7c-8c86-fa0b85f2deb5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.846717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.847778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.848214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.848486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.849971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.851977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:54.875978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1137/2234] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:54 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:54.880538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.893057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca23a1-0432-4b4a-98c7-5fc22ec18411 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.899949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.900178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.900339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.900615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.901415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.902999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:54.919704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1098/2235] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:54.922784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:54.935159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed78a37-525e-48c6-af0e-410f8b5db078 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:54.946165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea26704-b5ca-45af-a500-d1f67e081735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:54.946885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea26704-b5ca-45af-a500-d1f67e081735 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:54.947395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea26704-b5ca-45af-a500-d1f67e081735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:54.947681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea26704-b5ca-45af-a500-d1f67e081735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:54.948476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea26704-b5ca-45af-a500-d1f67e081735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:54.950217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea26704-b5ca-45af-a500-d1f67e081735 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.001540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1138/2236] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:55.005786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.017145 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3c451-d616-49cc-a5a8-ac854770bcfb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.026572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.027876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.028502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.028791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] PATH_INFO: `/v3/projects/7cc43f3cfa94405d9cf906692d7e6f0f/users/1f3e9876f2bf4f139cc67a9a18a51972/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.073754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc43f3cfa94405d9cf906692d7e6f0f, user_id=1f3e9876f2bf4f139cc67a9a18a51972, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.077909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.114162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1099/2237] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:55 2022] PUT /identity/v3/projects/7cc43f3cfa94405d9cf906692d7e6f0f/users/1f3e9876f2bf4f139cc67a9a18a51972/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:09:55.126108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.126398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.126676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.180415 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] MFA Rules not processed for user `1f3e9876f2bf4f139cc67a9a18a51972`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:55.181843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:55.266443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1139/2238] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:55.279951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.282231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:55.346949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.350897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:55.362787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:55.386703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff7263-7b95-4d95-9b2a-5b875c0b4089 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.392940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.404248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.404546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.404833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.410970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:55.416269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.419261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.445655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1100/2239] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:55.466525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.479029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec573c-106a-4f93-970a-808ef8194341 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.479895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d7639-7bf6-402f-8234-1b154d53708c service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.485075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.485817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.486604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.487002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.487264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.487519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.487864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] PATH_INFO: `/v3/users/1f3e9876f2bf4f139cc67a9a18a51972` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.487976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] PATH_INFO: `/v3/projects/dfe9c94610544bdb8de5bbada4186777` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.489484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3e9876f2bf4f139cc67a9a18a51972)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.490587 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe9c94610544bdb8de5bbada4186777)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.491822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.493086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.558813 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3e9876f2bf4f139cc67a9a18a51972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.569623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3e9876f2bf4f139cc67a9a18a51972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.570275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3e9876f2bf4f139cc67a9a18a51972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.570950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3e9876f2bf4f139cc67a9a18a51972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.573299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe9c94610544bdb8de5bbada4186777', 'request_id': 'req-70acfe0b-27b5-4590-af2a-2a9a19a14fce'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.580199 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe9c94610544bdb8de5bbada4186777', 'request_id': 'req-70acfe0b-27b5-4590-af2a-2a9a19a14fce'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.582451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-75255824-0cf9-4538-8cff-10a571811f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3e9876f2bf4f139cc67a9a18a51972'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.589067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe9c94610544bdb8de5bbada4186777', 'request_id': 'req-70acfe0b-27b5-4590-af2a-2a9a19a14fce'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.604377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] The token cache is being invalidate because project dfe9c94610544bdb8de5bbada4186777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:55.605380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.605497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1101/2240] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:09:55 2022] DELETE /identity/v3/users/1f3e9876f2bf4f139cc67a9a18a51972 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:55.605883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-70acfe0b-27b5-4590-af2a-2a9a19a14fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:55.607495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1140/2241] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:55 2022] DELETE /identity/v3/projects/dfe9c94610544bdb8de5bbada4186777 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:55.609666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.610025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.610372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.612227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20581-9194-4508-a7cb-2d27ed13f7db None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.612526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20581-9194-4508-a7cb-2d27ed13f7db None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.612909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20581-9194-4508-a7cb-2d27ed13f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.629289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:55.631552 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:55.636145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e4a20581-9194-4508-a7cb-2d27ed13f7db None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:55.637470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e4a20581-9194-4508-a7cb-2d27ed13f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:55.719933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1141/2242] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:55.723292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1102/2243] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:55.728335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5cfd-d3ea-45c9-a23d-0b54c5108a5a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.728621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5cfd-d3ea-45c9-a23d-0b54c5108a5a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.728899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5cfd-d3ea-45c9-a23d-0b54c5108a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.742981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.744420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:55.747812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cfcc5cfd-d3ea-45c9-a23d-0b54c5108a5a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:55.749221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cfcc5cfd-d3ea-45c9-a23d-0b54c5108a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:55.758898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1142/2244] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:55.763051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5cfd-d3ea-45c9-a23d-0b54c5108a5a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.773416 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5cfd-d3ea-45c9-a23d-0b54c5108a5a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.778678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.779338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.779624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.779901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.780656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:09:55.780962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.782624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.798014 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1143/2245] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:09:55.798944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.804272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fcc6f-1437-4235-a233-0a9c6a1677d4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.808549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.809202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.809533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.809716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9451956-8488-416b-b0e0-159220985c57 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.809811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.814287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.815182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.815464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.815763 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.816456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.818992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.821029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.822581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.829504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:55.832549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1103/2246] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:55.849204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1144/2247] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:55 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:55.853490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.863136 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79219e36-2811-4691-8e3c-8a921fac703b service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.868646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:55.930131 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.930727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.931013 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.931293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.932007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.933980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:55.958215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1104/2248] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:55 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:55.959529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:55.970192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec5ecc-4079-411b-815a-0a03c4d0199b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:55.974859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:55.975516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:55.975793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:55.976212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:55.976970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:55.978589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.009402 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1145/2249] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:56.012501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.026085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9223fe-853a-49b0-b502-b37544a6db4d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.041196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ddcf-80ca-419c-b16a-3a05832272b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.042772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ddcf-80ca-419c-b16a-3a05832272b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.043055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ddcf-80ca-419c-b16a-3a05832272b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.043761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ddcf-80ca-419c-b16a-3a05832272b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.044570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ddcf-80ca-419c-b16a-3a05832272b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.046949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ddcf-80ca-419c-b16a-3a05832272b8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.063294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1105/2250] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:56.064754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.082954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0466e-b341-44ce-9d34-0dc6d3330f76 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.096786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.096974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.097326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.097724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] PATH_INFO: `/v3/projects/db7f61c2f18e4cfc8bfdc276b66f8e81/users/504a4f5c65c4488ebc3d5a54ec4f2eeb/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.118371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7f61c2f18e4cfc8bfdc276b66f8e81, user_id=504a4f5c65c4488ebc3d5a54ec4f2eeb, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.121445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.138953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1146/2251] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:56 2022] PUT /identity/v3/projects/db7f61c2f18e4cfc8bfdc276b66f8e81/users/504a4f5c65c4488ebc3d5a54ec4f2eeb/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:56.150109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.150436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.150677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.183103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] MFA Rules not processed for user `504a4f5c65c4488ebc3d5a54ec4f2eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:56.184367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.238659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.241209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.275308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1106/2252] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:56.286420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.288051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.317040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fe825-26d8-4f32-8ea3-f563196fdae5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.322634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.323487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.323768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.324039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] PATH_INFO: `/v3/projects/7cc43f3cfa94405d9cf906692d7e6f0f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.325231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc43f3cfa94405d9cf906692d7e6f0f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.327179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.352825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b68e1-17ef-436b-876c-14958ade8831 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.357597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e7591-adff-4d34-9420-e6c7072c1241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.358326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7591-adff-4d34-9420-e6c7072c1241 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.358613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7591-adff-4d34-9420-e6c7072c1241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.358963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e7591-adff-4d34-9420-e6c7072c1241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.368518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e7591-adff-4d34-9420-e6c7072c1241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.369994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e7591-adff-4d34-9420-e6c7072c1241 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.376493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc43f3cfa94405d9cf906692d7e6f0f', 'request_id': 'req-86a25bc6-d2a0-4d26-92cf-704a154251db'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:56.379623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1107/2253] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:56.383313 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc43f3cfa94405d9cf906692d7e6f0f', 'request_id': 'req-86a25bc6-d2a0-4d26-92cf-704a154251db'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:56.390646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc43f3cfa94405d9cf906692d7e6f0f', 'request_id': 'req-86a25bc6-d2a0-4d26-92cf-704a154251db'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:56.403299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] The token cache is being invalidate because project 7cc43f3cfa94405d9cf906692d7e6f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:09:56.404868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:56.404868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-86a25bc6-d2a0-4d26-92cf-704a154251db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:09:56.409332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1147/2254] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:09:56 2022] DELETE /identity/v3/projects/7cc43f3cfa94405d9cf906692d7e6f0f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:09:56.414585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924b3d-3fd5-4ef4-82c1-d61bf9d8d4c9 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.414874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924b3d-3fd5-4ef4-82c1-d61bf9d8d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.415154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2924b3d-3fd5-4ef4-82c1-d61bf9d8d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.435472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f2924b3d-3fd5-4ef4-82c1-d61bf9d8d4c9 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:56.436619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f2924b3d-3fd5-4ef4-82c1-d61bf9d8d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.452281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:56.517088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1108/2255] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:56.518996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1132-f722-4f25-b948-1f619fed0962 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.519284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1132-f722-4f25-b948-1f619fed0962 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.519562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a1132-f722-4f25-b948-1f619fed0962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.542632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0e7a1132-f722-4f25-b948-1f619fed0962 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:56.543935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0e7a1132-f722-4f25-b948-1f619fed0962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.553029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1148/2256] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:56.557479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2924b3d-3fd5-4ef4-82c1-d61bf9d8d4c9 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.568889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2924b3d-3fd5-4ef4-82c1-d61bf9d8d4c9 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.574393 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.575174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.575547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.575828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.576565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:09:56.576869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.578538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.592366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1109/2257] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:09:56.597864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a1132-f722-4f25-b948-1f619fed0962 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.608480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a1132-f722-4f25-b948-1f619fed0962 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.613497 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.614760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.615177 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.615471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.616246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.618438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.647624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1149/2258] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:09:56 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:56.651898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.662938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91247627-a085-4b07-9162-1ed6def75eeb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.729731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.730627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.731592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.731968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.733437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.735681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.774989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1110/2259] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:09:56 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:09:56.776298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.796118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ed994-f63b-4801-9d4c-b5596b54040d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.820238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.820997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.821372 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.821753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.822547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.824291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.853661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.855421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.859246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1150/2260] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:09:56.866629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.884733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb952e47-bee5-4b3f-8979-71b241bb4304 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.894247 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.895806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.896554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.897126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.898806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.901421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.903807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:56.929913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1151/2261] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:09:56.931274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.945099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56c740-157f-4eac-96b4-818636f5bdaa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.951053 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32e079-39f0-430c-a653-e08b30a56ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.952361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32e079-39f0-430c-a653-e08b30a56ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.952474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25034f-990a-4f3f-972e-3716b1e9eaf6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.952954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32e079-39f0-430c-a653-e08b30a56ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.953793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32e079-39f0-430c-a653-e08b30a56ae5 admin admin] PATH_INFO: `/v3/projects/75c309cb09884a17909084bc3cfc329b/users/0149946f776b44668fcb6fece96cd199/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.958173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.959171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.959455 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.960278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.961807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.976472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32e079-39f0-430c-a653-e08b30a56ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c309cb09884a17909084bc3cfc329b, user_id=0149946f776b44668fcb6fece96cd199, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.979965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32e079-39f0-430c-a653-e08b30a56ae5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:57.001987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1152/2262] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:09:56 2022] PUT /identity/v3/projects/75c309cb09884a17909084bc3cfc329b/users/0149946f776b44668fcb6fece96cd199/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:09:57.017284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:57.028041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:57.029308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:57.044852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:57.064775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:57.066206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:57.068385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] MFA Rules not processed for user `0149946f776b44668fcb6fece96cd199`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:57.070427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:57.076958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1111/2263] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:57.146505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1153/2264] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:09:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:57.157684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:57.159095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:57.171342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b2ad7-824d-4132-9224-95077fe12694 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:57.226685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951e260-dee7-42c1-9249-94539fa3aa82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:57.227343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e260-dee7-42c1-9249-94539fa3aa82 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:57.227626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e260-dee7-42c1-9249-94539fa3aa82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:57.228028 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951e260-dee7-42c1-9249-94539fa3aa82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:57.239694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951e260-dee7-42c1-9249-94539fa3aa82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:57.241582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951e260-dee7-42c1-9249-94539fa3aa82 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:57.252017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1112/2265] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:02.661122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:02.662855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:02.731648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2b288-72bc-4ed1-81ae-5f43b7a2d25b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:02.736357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:02.737231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:02.737561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:02.737838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] PATH_INFO: `/v3/users/504a4f5c65c4488ebc3d5a54ec4f2eeb` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:02.739118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504a4f5c65c4488ebc3d5a54ec4f2eeb)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:02.741736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:02.802344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504a4f5c65c4488ebc3d5a54ec4f2eeb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:02.810594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504a4f5c65c4488ebc3d5a54ec4f2eeb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:02.811408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504a4f5c65c4488ebc3d5a54ec4f2eeb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:02.823069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:02.830050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504a4f5c65c4488ebc3d5a54ec4f2eeb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:02.831079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504a4f5c65c4488ebc3d5a54ec4f2eeb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:02.845674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1154/2266] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:02 2022] DELETE /identity/v3/users/504a4f5c65c4488ebc3d5a54ec4f2eeb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:02.851808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:02.852331 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:02.852543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:02.874639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:02.875634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:02.947355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1113/2267] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:02.958332 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:02.960215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:03.022386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec24fba-59c7-4dff-adb6-a18ca68ed6a5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:03.026105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:03.026752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:03.027039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:03.027320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:03.036494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:03.037967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:03.047488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1155/2268] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:03.337722 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:03.343571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:03.366138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a367ac-9877-44ef-82cd-3853b8a69ae3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:03.380627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:03.381892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:03.382183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:03.382519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] PATH_INFO: `/v3/projects/db7f61c2f18e4cfc8bfdc276b66f8e81` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:03.383857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7f61c2f18e4cfc8bfdc276b66f8e81)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:03.385885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:03.438208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7f61c2f18e4cfc8bfdc276b66f8e81', 'request_id': 'req-c58164a2-ba33-48da-a3f5-89cea980879d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:03.446822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7f61c2f18e4cfc8bfdc276b66f8e81', 'request_id': 'req-c58164a2-ba33-48da-a3f5-89cea980879d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:03.453529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7f61c2f18e4cfc8bfdc276b66f8e81', 'request_id': 'req-c58164a2-ba33-48da-a3f5-89cea980879d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:03.465219 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] The token cache is being invalidate because project db7f61c2f18e4cfc8bfdc276b66f8e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:03.465541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:03.466206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c58164a2-ba33-48da-a3f5-89cea980879d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:03.477073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1114/2269] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:03 2022] DELETE /identity/v3/projects/db7f61c2f18e4cfc8bfdc276b66f8e81 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:08.442125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:08.443553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:08.456686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098bc81-a482-4e1c-a9ca-088e205eb519 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:08.520544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:08.521832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:08.522113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:08.522385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] PATH_INFO: `/v3/users/0149946f776b44668fcb6fece96cd199` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:08.523599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0149946f776b44668fcb6fece96cd199)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:08.525586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:08.574457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0149946f776b44668fcb6fece96cd199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:08.581611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0149946f776b44668fcb6fece96cd199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:08.582325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0149946f776b44668fcb6fece96cd199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:08.594700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0149946f776b44668fcb6fece96cd199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:08.595296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0149946f776b44668fcb6fece96cd199'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:08.607638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1156/2270] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:08 2022] DELETE /identity/v3/users/0149946f776b44668fcb6fece96cd199 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:08.612309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:08.612737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:08.612865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:08.632033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:08.633260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:08.641512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:08.694877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1115/2271] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:08.704549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:08.706076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:08.711568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:08.767097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa9e21-81a0-4769-916b-19756bb6cc11 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:08.770830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c2209-3135-4259-b9df-bc31b083a701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:08.771477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c2209-3135-4259-b9df-bc31b083a701 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:08.771784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c2209-3135-4259-b9df-bc31b083a701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:08.772063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c2209-3135-4259-b9df-bc31b083a701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:08.781829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c2209-3135-4259-b9df-bc31b083a701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:08.783439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c2209-3135-4259-b9df-bc31b083a701 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:08.793841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1157/2272] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:09.804281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:09.805960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:09.820418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5ab0e-a2cb-412c-9ccf-238849015f45 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:09.827572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:09.828625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:09.829082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:09.829557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] PATH_INFO: `/v3/projects/75c309cb09884a17909084bc3cfc329b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:09.830999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c309cb09884a17909084bc3cfc329b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:09.833882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:09.889392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c309cb09884a17909084bc3cfc329b', 'request_id': 'req-49cb4c82-fafc-4ba0-9714-ead394e18e0c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:09.899076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c309cb09884a17909084bc3cfc329b', 'request_id': 'req-49cb4c82-fafc-4ba0-9714-ead394e18e0c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:09.905621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c309cb09884a17909084bc3cfc329b', 'request_id': 'req-49cb4c82-fafc-4ba0-9714-ead394e18e0c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:09.918327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] The token cache is being invalidate because project 75c309cb09884a17909084bc3cfc329b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:09.918705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:09.919363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:09.921109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1116/2273] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:09 2022] DELETE /identity/v3/projects/75c309cb09884a17909084bc3cfc329b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:15.384371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:15.384817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:15.384929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:15.403559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:15.404739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:15.460900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1158/2274] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:15.511524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:15.512972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:15.583960 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb4c82-fafc-4ba0-9714-ead394e18e0c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:15.589599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:15.590255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:15.590542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:15.590823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:15.599976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:15.601621 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:15.609729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1117/2275] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:10:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:10:25.453770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=50 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:25.606467 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:28.249909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:28.252227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:28.332097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b58e6-ae1c-444d-a84b-70e32cb56ed8 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:28.337932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:28.338817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:28.339098 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:28.339374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] PATH_INFO: `/v3/users/9246fac930804341bab7520b4c6b9d02` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:28.340640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9246fac930804341bab7520b4c6b9d02)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:28.342618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:28.408383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9246fac930804341bab7520b4c6b9d02'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.419713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9246fac930804341bab7520b4c6b9d02'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.421112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9246fac930804341bab7520b4c6b9d02'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.436759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9246fac930804341bab7520b4c6b9d02'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.439631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9246fac930804341bab7520b4c6b9d02'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.454550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1159/2276] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:28 2022] DELETE /identity/v3/users/9246fac930804341bab7520b4c6b9d02 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:28.705648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:28.735979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee251a91-c44d-4316-9fde-3c0424972a32 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:28.825717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:28.826877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:28.827050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:28.827432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] PATH_INFO: `/v3/projects/8ad727bc54734e0ea21825b7c8cda82a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:28.829063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad727bc54734e0ea21825b7c8cda82a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:28.831386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:28.898361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad727bc54734e0ea21825b7c8cda82a', 'request_id': 'req-ea2b2670-139b-41c0-b7e1-bcc187722d4e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.908333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad727bc54734e0ea21825b7c8cda82a', 'request_id': 'req-ea2b2670-139b-41c0-b7e1-bcc187722d4e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.916438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad727bc54734e0ea21825b7c8cda82a', 'request_id': 'req-ea2b2670-139b-41c0-b7e1-bcc187722d4e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.932655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] The token cache is being invalidate because project 8ad727bc54734e0ea21825b7c8cda82a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:28.932949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.934179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:28.939292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1118/2277] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:28 2022] DELETE /identity/v3/projects/8ad727bc54734e0ea21825b7c8cda82a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:28.941238 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:28.943274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:28.960923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d780a3e-a585-42c6-bd84-b1c5bae7dae0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:29.047815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:29.048803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:29.049186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:29.049572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] PATH_INFO: `/v3/users/b93428c805ef45ada4ad8a287435e412` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:29.050863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93428c805ef45ada4ad8a287435e412)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:29.052981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:29.080856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:29.117652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93428c805ef45ada4ad8a287435e412'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.130469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93428c805ef45ada4ad8a287435e412'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.132073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93428c805ef45ada4ad8a287435e412'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.152067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93428c805ef45ada4ad8a287435e412'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.153020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-93223405-a159-4c28-a332-6e10c957ac04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93428c805ef45ada4ad8a287435e412'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.175649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1160/2278] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:28 2022] DELETE /identity/v3/users/b93428c805ef45ada4ad8a287435e412 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:29.463150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:29.465172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:29.482499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b2670-139b-41c0-b7e1-bcc187722d4e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:29.552203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:29.553453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:29.553964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:29.554249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] PATH_INFO: `/v3/projects/945cf1ee02124324be8afd432fef3e3b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:29.555576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=945cf1ee02124324be8afd432fef3e3b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:29.557715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:29.604302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:29.625506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945cf1ee02124324be8afd432fef3e3b', 'request_id': 'req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.635344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945cf1ee02124324be8afd432fef3e3b', 'request_id': 'req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.643418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945cf1ee02124324be8afd432fef3e3b', 'request_id': 'req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.658253 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] The token cache is being invalidate because project 945cf1ee02124324be8afd432fef3e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:29.658886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.659775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b6c6e20f-ec0b-405f-9c37-ee1dc95d3e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:29.662565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1119/2279] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:29 2022] DELETE /identity/v3/projects/945cf1ee02124324be8afd432fef3e3b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:29.668509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889394-43c5-429a-83ac-213f501897da None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:29.669453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889394-43c5-429a-83ac-213f501897da None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:29.669942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889394-43c5-429a-83ac-213f501897da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:29.693006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0d889394-43c5-429a-83ac-213f501897da None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:29.694513 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0d889394-43c5-429a-83ac-213f501897da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:29.777655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1161/2280] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:29.781199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412341-fad9-42ec-9f2e-7288b830ee86 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:29.782002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412341-fad9-42ec-9f2e-7288b830ee86 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:29.782002 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3412341-fad9-42ec-9f2e-7288b830ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:29.807494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c3412341-fad9-42ec-9f2e-7288b830ee86 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:29.810057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c3412341-fad9-42ec-9f2e-7288b830ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:29.825742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1120/2281] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:29.829484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889394-43c5-429a-83ac-213f501897da None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:29.841120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889394-43c5-429a-83ac-213f501897da None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:29.847678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:29.848647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:29.849150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:29.849465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:29.850448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:10:29.851093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:29.853376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:29.867724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1162/2282] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:10:29.872793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3412341-fad9-42ec-9f2e-7288b830ee86 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:29.886383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3412341-fad9-42ec-9f2e-7288b830ee86 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:29.894635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:29.896006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:29.896311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:29.896613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:29.897651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:29.900068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:29.940605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1121/2283] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:10:29 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:29.943189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:29.954295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af274-7af1-414b-b4cf-9f14bbf5b88c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:30.025884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:30.026744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.027185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.027317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.028291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:30.030181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:30.055278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1163/2284] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:10:29 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:30.059629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:30.073724 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb3333-4188-4fc8-a9c6-19eabcf1c548 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:30.085001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:30.086069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.086536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.087004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.088080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:30.090039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:30.105588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1122/2285] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:30.108246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:30.124341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc8c79-e352-42e6-8a55-7ddf0b938c80 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:30.132876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d858d-8959-418d-aa6b-930eea17a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:30.134445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d858d-8959-418d-aa6b-930eea17a4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.134899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d858d-8959-418d-aa6b-930eea17a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.135182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d858d-8959-418d-aa6b-930eea17a4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.135931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d858d-8959-418d-aa6b-930eea17a4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:30.138869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d858d-8959-418d-aa6b-930eea17a4c7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:30.157866 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1164/2286] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:10:30.161442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:30.174241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4fe11-48c6-41c5-b754-53f2303d3433 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:30.179820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:30.181594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.182018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.182422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] PATH_INFO: `/v3/projects/1449797ec92548c5b73b33587754c8fb/users/824ac4cfa4ac47e1810205de85c6199b/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.204005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1449797ec92548c5b73b33587754c8fb, user_id=824ac4cfa4ac47e1810205de85c6199b, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:30.208357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:30.227884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1123/2287] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:30 2022] PUT /identity/v3/projects/1449797ec92548c5b73b33587754c8fb/users/824ac4cfa4ac47e1810205de85c6199b/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:30.238349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335ec7-2485-449c-86dc-140bada7273a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.239204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335ec7-2485-449c-86dc-140bada7273a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.239566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db335ec7-2485-449c-86dc-140bada7273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.247796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:30.289967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-db335ec7-2485-449c-86dc-140bada7273a None None] MFA Rules not processed for user `824ac4cfa4ac47e1810205de85c6199b`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:30.292034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-db335ec7-2485-449c-86dc-140bada7273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:30.376797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1165/2288] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:30.388569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:30.390750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:30.461465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c961385-6bd5-47f1-bdce-cb169e048361 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:30.465618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc2bc7-5faa-4f81-b1b2-9debcb3e7871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:30.466495 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc2bc7-5faa-4f81-b1b2-9debcb3e7871 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.466868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc2bc7-5faa-4f81-b1b2-9debcb3e7871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.467235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc2bc7-5faa-4f81-b1b2-9debcb3e7871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.478861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc2bc7-5faa-4f81-b1b2-9debcb3e7871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:30.480733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc2bc7-5faa-4f81-b1b2-9debcb3e7871 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:30.492866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1124/2289] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:30.511846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db335ec7-2485-449c-86dc-140bada7273a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:30.603192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db335ec7-2485-449c-86dc-140bada7273a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:30.632928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:30.633937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.634230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.634494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] PATH_INFO: `/v3/users/824ac4cfa4ac47e1810205de85c6199b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.635755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824ac4cfa4ac47e1810205de85c6199b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:30.637680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:30.693953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824ac4cfa4ac47e1810205de85c6199b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:30.705699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824ac4cfa4ac47e1810205de85c6199b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:30.706875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824ac4cfa4ac47e1810205de85c6199b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:30.721931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824ac4cfa4ac47e1810205de85c6199b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:30.722620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824ac4cfa4ac47e1810205de85c6199b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:30.745842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1166/2290] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:30 2022] DELETE /identity/v3/users/824ac4cfa4ac47e1810205de85c6199b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:30.750649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.750938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.751220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.768750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:30.769571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:30.829818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:30.842549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1125/2291] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:30.855426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:30.856915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:30.874443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:30.931522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503a1b4-9260-4942-a7a3-13bb8dba9568 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:30.936665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8b1a-02b3-48e5-a0ed-ca3904dc5df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:30.937481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8b1a-02b3-48e5-a0ed-ca3904dc5df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:30.937786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8b1a-02b3-48e5-a0ed-ca3904dc5df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:30.938572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8b1a-02b3-48e5-a0ed-ca3904dc5df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:30.952493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd8b1a-02b3-48e5-a0ed-ca3904dc5df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:30.954898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd8b1a-02b3-48e5-a0ed-ca3904dc5df4 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:30.969224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1167/2292] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:31.290845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:31.292509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:31.305954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e7c9-9a48-4cb8-b186-58cb3e3d9807 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:31.315358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:31.318301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:31.318793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:31.319291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] PATH_INFO: `/v3/projects/1449797ec92548c5b73b33587754c8fb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:31.321520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1449797ec92548c5b73b33587754c8fb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:31.325698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:31.403968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1449797ec92548c5b73b33587754c8fb', 'request_id': 'req-da7c30fc-fcd1-4da1-9496-4fc2edf20435'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:31.415845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1449797ec92548c5b73b33587754c8fb', 'request_id': 'req-da7c30fc-fcd1-4da1-9496-4fc2edf20435'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:31.426293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1449797ec92548c5b73b33587754c8fb', 'request_id': 'req-da7c30fc-fcd1-4da1-9496-4fc2edf20435'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:31.440812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] The token cache is being invalidate because project 1449797ec92548c5b73b33587754c8fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:31.441103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:31.442037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-da7c30fc-fcd1-4da1-9496-4fc2edf20435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:31.444032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1126/2293] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:31 2022] DELETE /identity/v3/projects/1449797ec92548c5b73b33587754c8fb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:10:31.449090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d011bd-7763-4ed3-98aa-f006214f0632 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:31.449392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d011bd-7763-4ed3-98aa-f006214f0632 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:31.449681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d011bd-7763-4ed3-98aa-f006214f0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:31.469728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-30d011bd-7763-4ed3-98aa-f006214f0632 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:31.470952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-30d011bd-7763-4ed3-98aa-f006214f0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:31.542256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1168/2294] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:31.552457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cee67-6875-45c3-b339-f25e12f2aea5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:31.552750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cee67-6875-45c3-b339-f25e12f2aea5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:31.553051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cee67-6875-45c3-b339-f25e12f2aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:31.578712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-927cee67-6875-45c3-b339-f25e12f2aea5 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:31.580281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-927cee67-6875-45c3-b339-f25e12f2aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:31.593391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1127/2295] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:31.595701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d011bd-7763-4ed3-98aa-f006214f0632 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:31.607740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d011bd-7763-4ed3-98aa-f006214f0632 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:31.612401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:31.613060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:31.613337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:31.614295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:31.615013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:10:31.615317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:31.616910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:31.630911 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1169/2296] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:10:31.637305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cee67-6875-45c3-b339-f25e12f2aea5 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:31.652274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cee67-6875-45c3-b339-f25e12f2aea5 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:31.661509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:31.662499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:31.662789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:31.663066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:31.663793 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:31.665952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:31.710204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1128/2297] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:10:31 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:31.711446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:31.729656 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5972237-bbfc-4175-a35d-d6115bc46e67 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:31.827290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:31.827987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:31.828267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:31.828548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:31.829368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:31.831284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:31.871973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1170/2298] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:10:31 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:10:31.875967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:31.915519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a879e5-4d1f-4f1d-94a2-6da4b01fc6f3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:31.939962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:31.942468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:31.943564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:31.944575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:31.946278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:31.948974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:31.970089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1129/2299] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:31.975462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:31.997438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b7a0c-a9e8-4cd6-9379-b22748fa3701 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:32.009391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c4190-dc60-4d2c-9739-ca2ade3fd9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:32.009391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c4190-dc60-4d2c-9739-ca2ade3fd9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:32.009391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c4190-dc60-4d2c-9739-ca2ade3fd9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:32.009391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c4190-dc60-4d2c-9739-ca2ade3fd9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:32.009966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c4190-dc60-4d2c-9739-ca2ade3fd9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:32.010861 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c4190-dc60-4d2c-9739-ca2ade3fd9bb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:32.041071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1171/2300] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:32.045981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:32.090769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6977b-b5e1-458e-b608-b17047d99202 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:32.095141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:32.096284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:32.096585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:32.096809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] PATH_INFO: `/v3/projects/51ee3a3b2a87447a8ea365245dca0a62/users/37bf704662fc49ef9d1f29f61fe434f2/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:32.138211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ee3a3b2a87447a8ea365245dca0a62, user_id=37bf704662fc49ef9d1f29f61fe434f2, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:32.141539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:32.172746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1130/2301] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:32 2022] PUT /identity/v3/projects/51ee3a3b2a87447a8ea365245dca0a62/users/37bf704662fc49ef9d1f29f61fe434f2/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:32.183471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc5133-b9d0-408d-974d-ad00594997d6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:32.183880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc5133-b9d0-408d-974d-ad00594997d6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:32.184334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc5133-b9d0-408d-974d-ad00594997d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:32.232082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a5dc5133-b9d0-408d-974d-ad00594997d6 None None] MFA Rules not processed for user `37bf704662fc49ef9d1f29f61fe434f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:32.234159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a5dc5133-b9d0-408d-974d-ad00594997d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:32.263379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:32.356138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1172/2302] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:32.367561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:32.370454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:32.456107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1055df-1cd3-4b47-9d4c-e11f0db1d131 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:32.460926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bfc02-33df-492b-a9b7-73ae67fd9914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:32.461760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bfc02-33df-492b-a9b7-73ae67fd9914 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:32.462044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bfc02-33df-492b-a9b7-73ae67fd9914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:32.462380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bfc02-33df-492b-a9b7-73ae67fd9914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:32.474129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bfc02-33df-492b-a9b7-73ae67fd9914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:32.475671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bfc02-33df-492b-a9b7-73ae67fd9914 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:32.494287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1131/2303] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:38.274766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc5133-b9d0-408d-974d-ad00594997d6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:38.342697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc5133-b9d0-408d-974d-ad00594997d6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:38.347271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:38.348714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:38.348978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:38.349257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] PATH_INFO: `/v3/users/37bf704662fc49ef9d1f29f61fe434f2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:38.350487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=37bf704662fc49ef9d1f29f61fe434f2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:38.352410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:38.401239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37bf704662fc49ef9d1f29f61fe434f2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:38.410813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37bf704662fc49ef9d1f29f61fe434f2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:38.411692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37bf704662fc49ef9d1f29f61fe434f2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:38.423628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37bf704662fc49ef9d1f29f61fe434f2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:38.424274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-fea36d89-20ae-4cfb-9954-4233d10309fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37bf704662fc49ef9d1f29f61fe434f2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:38.436853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1173/2304] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:38 2022] DELETE /identity/v3/users/37bf704662fc49ef9d1f29f61fe434f2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:38.441246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153716a-bf84-4174-a199-8573657a41da None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:38.441860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153716a-bf84-4174-a199-8573657a41da None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:38.441860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153716a-bf84-4174-a199-8573657a41da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:38.459283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b153716a-bf84-4174-a199-8573657a41da None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:38.460490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b153716a-bf84-4174-a199-8573657a41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:38.480354 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:38.547044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1132/2305] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:38.554596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:38.554891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:38.555188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:38.556779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153716a-bf84-4174-a199-8573657a41da None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:38.558209 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b153716a-bf84-4174-a199-8573657a41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:38.574597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:38.575889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:38.602988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:38.619719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153716a-bf84-4174-a199-8573657a41da None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:38.623336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:38.624012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:38.624296 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:38.624573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:38.634943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:38.636419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:38.638212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1174/2306] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 14:10:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:38.648149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1133/2307] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:10:38.656534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:38.658213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:38.737204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dfaa9-d914-4cf1-bf9c-31be903c20de None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:38.743300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775af3e-0a86-40d5-9672-1133a00a7bf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:38.744608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775af3e-0a86-40d5-9672-1133a00a7bf4 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:38.744871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775af3e-0a86-40d5-9672-1133a00a7bf4 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:38.745147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775af3e-0a86-40d5-9672-1133a00a7bf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:38.754094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775af3e-0a86-40d5-9672-1133a00a7bf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:38.755845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775af3e-0a86-40d5-9672-1133a00a7bf4 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:38.765104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1175/2308] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:10:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:10:38.930006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:38.931739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:38.949137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7905-caf8-4dd6-9bca-0ac8af792022 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:38.955080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:38.955987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:38.956260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:38.956525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] PATH_INFO: `/v3/projects/51ee3a3b2a87447a8ea365245dca0a62` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:38.958649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ee3a3b2a87447a8ea365245dca0a62)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:38.960696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.023603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ee3a3b2a87447a8ea365245dca0a62', 'request_id': 'req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:39.032146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ee3a3b2a87447a8ea365245dca0a62', 'request_id': 'req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:39.038626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ee3a3b2a87447a8ea365245dca0a62', 'request_id': 'req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:39.050862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] The token cache is being invalidate because project 51ee3a3b2a87447a8ea365245dca0a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:39.051179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:39.051834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3d7a57b6-6be7-4c4b-a058-ca921fff1da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:39.053782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1134/2309] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:38 2022] DELETE /identity/v3/projects/51ee3a3b2a87447a8ea365245dca0a62 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:39.058549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48d46-26c9-4027-aff3-e30002557e21 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.058844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48d46-26c9-4027-aff3-e30002557e21 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.059136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48d46-26c9-4027-aff3-e30002557e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.078781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a7b48d46-26c9-4027-aff3-e30002557e21 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:39.079973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a7b48d46-26c9-4027-aff3-e30002557e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:39.151000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1176/2310] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:39.158925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05dee-368e-4502-80c2-b9f7d029d55f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.159221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05dee-368e-4502-80c2-b9f7d029d55f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.159504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05dee-368e-4502-80c2-b9f7d029d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.183993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d3e05dee-368e-4502-80c2-b9f7d029d55f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:39.185203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d3e05dee-368e-4502-80c2-b9f7d029d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:39.200044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1135/2311] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:39.204588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48d46-26c9-4027-aff3-e30002557e21 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.215379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48d46-26c9-4027-aff3-e30002557e21 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.220117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.220838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.221136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.221470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.222198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:10:39.222544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.224273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.237412 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1177/2312] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:10:39.241932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05dee-368e-4502-80c2-b9f7d029d55f None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.251373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05dee-368e-4502-80c2-b9f7d029d55f None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.256989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.257689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.257979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.258260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.258972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.260918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.286188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1136/2313] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:10:39 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:39.290758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.301941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db274722-3815-40fc-82e9-d1330cc11020 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.349026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:39.358566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.359240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.359524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.359802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.360503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.362467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.383373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1178/2314] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:10:39 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:10:39.387445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.398030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad426913-62d7-47ea-8770-4956fba6a39a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.402640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.403301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.403582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.403860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.404590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.406233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.416729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1137/2315] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:39.420591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.431982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69cd72-b9d7-455d-8593-ad336b1d13a4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.436891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180517d-124a-492e-81c7-f59409bd628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.437579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180517d-124a-492e-81c7-f59409bd628a admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.438121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180517d-124a-492e-81c7-f59409bd628a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.438398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180517d-124a-492e-81c7-f59409bd628a admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.439155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180517d-124a-492e-81c7-f59409bd628a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.440748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180517d-124a-492e-81c7-f59409bd628a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.452674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1179/2316] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:39.456949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.467300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd7607-4187-41b3-8029-5fbc94cba522 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.471993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.473506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.473829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.474167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] PATH_INFO: `/v3/projects/18e3e985a36b44b7b4f80d5c62cda4cd/users/f74234e794d24d56ae1359d26c715b3b/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.478751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:39.494911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e3e985a36b44b7b4f80d5c62cda4cd, user_id=f74234e794d24d56ae1359d26c715b3b, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.497714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.512660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1138/2317] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:39 2022] PUT /identity/v3/projects/18e3e985a36b44b7b4f80d5c62cda4cd/users/f74234e794d24d56ae1359d26c715b3b/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:39.524511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3216e0-0d51-4a71-9c50-ecd382760d17 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.524800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3216e0-0d51-4a71-9c50-ecd382760d17 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.525114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3216e0-0d51-4a71-9c50-ecd382760d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.556479 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-da3216e0-0d51-4a71-9c50-ecd382760d17 None None] MFA Rules not processed for user `f74234e794d24d56ae1359d26c715b3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:39.557738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-da3216e0-0d51-4a71-9c50-ecd382760d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:39.646888 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1180/2318] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:39.651320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.729411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a784a16-45b2-4b4f-a1ee-8667d1fff38c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.734786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.735938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.735938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.736169 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.736796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.739723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.771259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1139/2319] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:10:39 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:10:39.775682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3216e0-0d51-4a71-9c50-ecd382760d17 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.791571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3216e0-0d51-4a71-9c50-ecd382760d17 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.874033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.874969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.875391 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.875768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.876584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.878695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.907381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1181/2320] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:10:39 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:39.907988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.920038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a1ae9-0660-49f5-a3e2-f51fdee3b3e6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.927027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.928072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.928363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.929612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.929612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.931175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.943678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1140/2321] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:39.948004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:39.960070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4893e-b236-423b-b29f-a5502498f2e9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:39.967795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b26ac-75b5-4051-8667-877b523e744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:39.968675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b26ac-75b5-4051-8667-877b523e744f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:39.969028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b26ac-75b5-4051-8667-877b523e744f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:39.969219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b26ac-75b5-4051-8667-877b523e744f admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:39.969984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b26ac-75b5-4051-8667-877b523e744f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:39.971586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b26ac-75b5-4051-8667-877b523e744f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:39.989222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1182/2322] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:39.996469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.007912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f59eea-9646-4600-a757-e521749464d8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:40.014579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:40.016184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.016184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.016184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] PATH_INFO: `/v3/projects/d2509c1a60974a5b83f533951a8d2303/users/a6bd919a47be401595157e79f043c4f0/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.032785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2509c1a60974a5b83f533951a8d2303, user_id=a6bd919a47be401595157e79f043c4f0, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:40.036334 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:40.051787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1141/2323] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:39 2022] PUT /identity/v3/projects/d2509c1a60974a5b83f533951a8d2303/users/a6bd919a47be401595157e79f043c4f0/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:40.064664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7cd64-5748-41d8-b7dd-2951cfdb5e24 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.065084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7cd64-5748-41d8-b7dd-2951cfdb5e24 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.065976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7cd64-5748-41d8-b7dd-2951cfdb5e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.114367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-30e7cd64-5748-41d8-b7dd-2951cfdb5e24 None None] MFA Rules not processed for user `a6bd919a47be401595157e79f043c4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:40.115785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-30e7cd64-5748-41d8-b7dd-2951cfdb5e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:40.155762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:40.204585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1183/2324] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:40.205618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.300116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401a447-8a54-4ae8-925e-9261895c42f6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:40.310756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:40.311605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.312023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.312405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.314607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:40.316950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:40.360891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1142/2325] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:10:40 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:40.362630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7cd64-5748-41d8-b7dd-2951cfdb5e24 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.382662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7cd64-5748-41d8-b7dd-2951cfdb5e24 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:40.456022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:40.457627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.458193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.458648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.459515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:40.463045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:40.488778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1184/2326] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:10:40 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:10:40.493309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.505605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd9e97-5eb7-4ec0-a2b1-5a197fff5567 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:40.510576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:40.511305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.511699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.511979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.512719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:40.514522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:40.531196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1143/2327] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:10:40.532442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.545589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15038024-82a3-4d60-9b80-b3eb49d99ae0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:40.551182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:40.552252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.552627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.553410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] PATH_INFO: `/v3/projects/7c5cbefecfa441a2932774acdb7bfe1a/users/83fdbbbb1d3149788bbce13908bdd51f/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.573784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5cbefecfa441a2932774acdb7bfe1a, user_id=83fdbbbb1d3149788bbce13908bdd51f, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:40.576473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:40.594168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1185/2328] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:40 2022] PUT /identity/v3/projects/7c5cbefecfa441a2932774acdb7bfe1a/users/83fdbbbb1d3149788bbce13908bdd51f/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:40.598472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.609771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3159d4b-66e4-4181-a5a3-708bd292bb3e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:40.616073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:40.688758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e0dcb-5273-4986-b4f4-90de6ef5bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:40.690612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0dcb-5273-4986-b4f4-90de6ef5bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.691932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0dcb-5273-4986-b4f4-90de6ef5bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.692478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e0dcb-5273-4986-b4f4-90de6ef5bdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.693935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0dcb-5273-4986-b4f4-90de6ef5bdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:40.695833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e0dcb-5273-4986-b4f4-90de6ef5bdb5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:40.713408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1144/2329] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:40.717125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.728478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4116-47d4-470e-80ee-e659ca8d17ab admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:40.733825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:40.735029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.735382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.735730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] PATH_INFO: `/v3/projects/7c5cbefecfa441a2932774acdb7bfe1a/users/83fdbbbb1d3149788bbce13908bdd51f/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.738840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5cbefecfa441a2932774acdb7bfe1a, user_id=83fdbbbb1d3149788bbce13908bdd51f, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:40.742361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:40.756340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1186/2330] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:40 2022] PUT /identity/v3/projects/7c5cbefecfa441a2932774acdb7bfe1a/users/83fdbbbb1d3149788bbce13908bdd51f/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:40.767568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:40.768146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:40.768427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:40.798439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] MFA Rules not processed for user `83fdbbbb1d3149788bbce13908bdd51f`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:40.799661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:40.901851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:40.904182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:40.949903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1145/2331] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:41.018127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49975926-df58-418e-9e4a-6378b8a57568 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:41.028037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:41.028309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:41.031460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.031726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.031842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:41.031998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] PATH_INFO: `/v3/users/52490fb84bb343d9af6eeaae1dc50aa8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.033461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52490fb84bb343d9af6eeaae1dc50aa8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:41.036524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:41.079565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:41.128773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52490fb84bb343d9af6eeaae1dc50aa8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.132445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c089d1-0fad-494b-aff6-9d8695bb0cdd None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:41.137052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:41.137778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.138060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.138329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.139029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52490fb84bb343d9af6eeaae1dc50aa8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.139700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52490fb84bb343d9af6eeaae1dc50aa8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.154723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52490fb84bb343d9af6eeaae1dc50aa8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.155730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-802f94f9-c401-41a7-9914-f81c6af8e26f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52490fb84bb343d9af6eeaae1dc50aa8'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.171304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1187/2332] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:40 2022] DELETE /identity/v3/users/52490fb84bb343d9af6eeaae1dc50aa8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:10:41.189441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:41.205398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:41.207549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:41.218685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1146/2333] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:10:41.311733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6021c6-a5ee-46de-b9b3-a146128fa1ce None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.312032 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6021c6-a5ee-46de-b9b3-a146128fa1ce None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.312307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6021c6-a5ee-46de-b9b3-a146128fa1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.335346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-4a6021c6-a5ee-46de-b9b3-a146128fa1ce None None] MFA Rules not processed for user `887e53c1e74543ce914f94c0b2666fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:41.336555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4a6021c6-a5ee-46de-b9b3-a146128fa1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:41.403365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:41.405939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1188/2334] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:41.418182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dfe99-141e-411b-a819-aa4135f798a2 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:41.508503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:41.509469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.510425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.510843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] PATH_INFO: `/v3/projects/ba96105733ea472eb897c261a770e9a6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.512833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba96105733ea472eb897c261a770e9a6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:41.515003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:41.595247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba96105733ea472eb897c261a770e9a6', 'request_id': 'req-5aad4331-c523-48c0-b748-e0411b0368d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.604895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba96105733ea472eb897c261a770e9a6', 'request_id': 'req-5aad4331-c523-48c0-b748-e0411b0368d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.613757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba96105733ea472eb897c261a770e9a6', 'request_id': 'req-5aad4331-c523-48c0-b748-e0411b0368d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.626941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] The token cache is being invalidate because project ba96105733ea472eb897c261a770e9a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:41.627301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.628025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5aad4331-c523-48c0-b748-e0411b0368d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:41.630516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1147/2335] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:41 2022] DELETE /identity/v3/projects/ba96105733ea472eb897c261a770e9a6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:10:41.635641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b441-9893-42f1-a889-7062d2923451 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.635844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b441-9893-42f1-a889-7062d2923451 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.636124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b441-9893-42f1-a889-7062d2923451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.657045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f3d9b441-9893-42f1-a889-7062d2923451 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:41.658305 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f3d9b441-9893-42f1-a889-7062d2923451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:41.724633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1189/2336] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:41.732699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9809948-f73c-45f0-8701-c1a2f184b17a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.733070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9809948-f73c-45f0-8701-c1a2f184b17a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.733522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9809948-f73c-45f0-8701-c1a2f184b17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.753920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e9809948-f73c-45f0-8701-c1a2f184b17a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:41.755390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e9809948-f73c-45f0-8701-c1a2f184b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:41.763312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1148/2337] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:41.767658 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b441-9893-42f1-a889-7062d2923451 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:41.778153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b441-9893-42f1-a889-7062d2923451 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:41.782754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:41.783407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.783683 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.783954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.785231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:10:41.785665 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:41.787265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:41.803282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1190/2338] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:10:41.804500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9809948-f73c-45f0-8701-c1a2f184b17a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:41.814762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9809948-f73c-45f0-8701-c1a2f184b17a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:41.819733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:41.820391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.820677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.820955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.821685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:41.823606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:41.853139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1149/2339] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:10:41 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:41.854290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:41.865527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04b9a4-a2e3-428b-b9fd-0ab5945a15f3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:41.897578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:41.931302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:41.931974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.932252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.932540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.933252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:41.935236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:41.960470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1191/2340] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:10:41 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:10:41.964824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:41.976127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b72a0be-541e-4ef4-b02b-afaec7882a49 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:41.980957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:41.981660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.981945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.982218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.982946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:41.984649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:41.996735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1150/2341] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:10:42.000830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:42.010951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8459bf0-72ff-4511-944d-aafeddfa2ef0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:42.015804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fc42f-8ef3-466d-b914-69f848f0a4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:42.016464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc42f-8ef3-466d-b914-69f848f0a4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:42.016749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc42f-8ef3-466d-b914-69f848f0a4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:42.017028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc42f-8ef3-466d-b914-69f848f0a4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:42.017797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fc42f-8ef3-466d-b914-69f848f0a4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:42.019511 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fc42f-8ef3-466d-b914-69f848f0a4b2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:42.030582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1192/2342] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:42.035286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:42.046077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4063f3-6787-416b-9572-5e030ad17bb6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:42.051832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:42.052728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:42.053042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:42.053283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] PATH_INFO: `/v3/projects/1098e2703d7343a59318309d79fd8032/users/f3e94f649d30435e81cf210a52092e7d/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:42.069044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1098e2703d7343a59318309d79fd8032, user_id=f3e94f649d30435e81cf210a52092e7d, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:42.071871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:42.089134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1151/2343] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:42 2022] PUT /identity/v3/projects/1098e2703d7343a59318309d79fd8032/users/f3e94f649d30435e81cf210a52092e7d/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:10:42.100025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:42.100575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:42.100575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:42.138603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] MFA Rules not processed for user `f3e94f649d30435e81cf210a52092e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:42.140410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:42.215880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1193/2344] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:42.228108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:42.229867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:42.244118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:42.294973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3856-c5ae-4253-aba6-b8c36bae2a22 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:42.299576 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:42.300613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:42.300613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:42.300949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:42.310807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:42.312329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:42.322422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1152/2345] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:42.794203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:42.795893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:42.861477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bea9f8-a485-4216-afb5-a96fadb661f7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:42.866153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:42.866835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:42.867266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:42.867450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:42.869201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:42.929687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:42.932125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:42.934070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:42.944499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1194/2346] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:43.629990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:43.639667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f97b5f-ab78-42de-8d91-ae40fb7a6880 service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:43.643236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98921e91-c836-4966-b0e0-372c7daa082b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:43.643917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921e91-c836-4966-b0e0-372c7daa082b service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:43.644356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921e91-c836-4966-b0e0-372c7daa082b service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:43.644838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98921e91-c836-4966-b0e0-372c7daa082b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:43.647234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-98921e91-c836-4966-b0e0-372c7daa082b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:43.714020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98921e91-c836-4966-b0e0-372c7daa082b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:43.715456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98921e91-c836-4966-b0e0-372c7daa082b service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:43.725379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1153/2347] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:47.660534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:47.662257 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:47.726771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897814e-9ba7-429c-9b0c-a7864ea40498 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:47.731211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:47.732070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:47.732349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:47.732623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] PATH_INFO: `/v3/users/f74234e794d24d56ae1359d26c715b3b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:47.733823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74234e794d24d56ae1359d26c715b3b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:47.735734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:47.781254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74234e794d24d56ae1359d26c715b3b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:47.788719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74234e794d24d56ae1359d26c715b3b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:47.789385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74234e794d24d56ae1359d26c715b3b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:47.802002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74234e794d24d56ae1359d26c715b3b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:47.802704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74234e794d24d56ae1359d26c715b3b'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:47.816168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1195/2348] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:47 2022] DELETE /identity/v3/users/f74234e794d24d56ae1359d26c715b3b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:47.821162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:47.821682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:47.821797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:47.840770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:47.842096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:47.905922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1154/2349] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:47.918791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:47.920244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:47.985312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebefe0-1a01-490c-85a0-b5be522c31ae admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:47.989103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:47.989793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:47.990076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:47.990353 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:47.999577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:48.001035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:48.012228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1196/2350] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:48.300454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:48.301996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:48.314323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d6bd-3ed9-4827-8046-4b960ab44a90 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:48.319766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:48.320715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:48.321102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:48.321463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] PATH_INFO: `/v3/projects/18e3e985a36b44b7b4f80d5c62cda4cd` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:48.322732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e3e985a36b44b7b4f80d5c62cda4cd)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:48.324891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:48.370130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:48.374461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e3e985a36b44b7b4f80d5c62cda4cd', 'request_id': 'req-ba7521c8-63ae-406e-943a-47de82f90909'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.384065 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e3e985a36b44b7b4f80d5c62cda4cd', 'request_id': 'req-ba7521c8-63ae-406e-943a-47de82f90909'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.389854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e3e985a36b44b7b4f80d5c62cda4cd', 'request_id': 'req-ba7521c8-63ae-406e-943a-47de82f90909'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.400807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] The token cache is being invalidate because project 18e3e985a36b44b7b4f80d5c62cda4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:48.401088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.401720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.403252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1155/2351] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:48 2022] DELETE /identity/v3/projects/18e3e985a36b44b7b4f80d5c62cda4cd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:48.407280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:48.417059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc719c-001e-45f5-8775-08acf8f9b8f6 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:48.430335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:48.477561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:48.478433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:48.478716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:48.478993 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] PATH_INFO: `/v3/users/a6bd919a47be401595157e79f043c4f0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:48.480185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bd919a47be401595157e79f043c4f0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:48.482193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:48.536850 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bd919a47be401595157e79f043c4f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.544180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bd919a47be401595157e79f043c4f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.544885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bd919a47be401595157e79f043c4f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.557730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bd919a47be401595157e79f043c4f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.558454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bd919a47be401595157e79f043c4f0'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.573142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1197/2352] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:48 2022] DELETE /identity/v3/users/a6bd919a47be401595157e79f043c4f0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:48.849367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:48.850856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:48.865806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7521c8-63ae-406e-943a-47de82f90909 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:48.931834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:48.932616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:48.932897 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:48.933179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] PATH_INFO: `/v3/projects/d2509c1a60974a5b83f533951a8d2303` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:48.934389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2509c1a60974a5b83f533951a8d2303)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:48.936321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:48.987855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2509c1a60974a5b83f533951a8d2303', 'request_id': 'req-d82d5eb8-d421-464a-bb73-202e7d789097'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:48.996383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2509c1a60974a5b83f533951a8d2303', 'request_id': 'req-d82d5eb8-d421-464a-bb73-202e7d789097'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.003031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2509c1a60974a5b83f533951a8d2303', 'request_id': 'req-d82d5eb8-d421-464a-bb73-202e7d789097'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.014504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] The token cache is being invalidate because project d2509c1a60974a5b83f533951a8d2303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:49.014782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.015426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.016979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1156/2353] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:48 2022] DELETE /identity/v3/projects/d2509c1a60974a5b83f533951a8d2303 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:49.021226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:49.022876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:49.035973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3333-1f89-4e25-b176-ed9e7cbacf9d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:49.104615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:49.105519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.105801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.106074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] PATH_INFO: `/v3/users/83fdbbbb1d3149788bbce13908bdd51f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.107283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fdbbbb1d3149788bbce13908bdd51f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:49.109215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:49.168406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:49.172203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fdbbbb1d3149788bbce13908bdd51f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.181061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fdbbbb1d3149788bbce13908bdd51f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.181764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fdbbbb1d3149788bbce13908bdd51f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.195598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fdbbbb1d3149788bbce13908bdd51f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.196241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-431d97ab-00e0-4ce7-8523-0aa55b27a56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fdbbbb1d3149788bbce13908bdd51f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.211987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1198/2354] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:10:49 2022] DELETE /identity/v3/users/83fdbbbb1d3149788bbce13908bdd51f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:49.518167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:49.520482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:49.537567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d5eb8-d421-464a-bb73-202e7d789097 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:49.616751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:49.617703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.617991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.618308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] PATH_INFO: `/v3/projects/7c5cbefecfa441a2932774acdb7bfe1a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.620180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5cbefecfa441a2932774acdb7bfe1a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:49.624426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:49.627288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:49.687099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5cbefecfa441a2932774acdb7bfe1a', 'request_id': 'req-ef371985-fa99-450b-8b89-266554ea1fa8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.699301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5cbefecfa441a2932774acdb7bfe1a', 'request_id': 'req-ef371985-fa99-450b-8b89-266554ea1fa8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.707023 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5cbefecfa441a2932774acdb7bfe1a', 'request_id': 'req-ef371985-fa99-450b-8b89-266554ea1fa8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.721239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] The token cache is being invalidate because project 7c5cbefecfa441a2932774acdb7bfe1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:10:49.721617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.723018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-ef371985-fa99-450b-8b89-266554ea1fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:10:49.725297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1157/2355] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:10:49 2022] DELETE /identity/v3/projects/7c5cbefecfa441a2932774acdb7bfe1a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:49.730159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d887-fa62-4c08-bd24-0d014cffc7fc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.730460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d887-fa62-4c08-bd24-0d014cffc7fc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.731193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d887-fa62-4c08-bd24-0d014cffc7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.755684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1942d887-fa62-4c08-bd24-0d014cffc7fc None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:49.757363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1942d887-fa62-4c08-bd24-0d014cffc7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:49.847433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1199/2356] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:49.856431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4c26-857d-4232-a4c9-c4047e39410d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.856994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4c26-857d-4232-a4c9-c4047e39410d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.857461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d4c26-857d-4232-a4c9-c4047e39410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.887597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b18d4c26-857d-4232-a4c9-c4047e39410d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:49.889375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b18d4c26-857d-4232-a4c9-c4047e39410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:49.900039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1158/2357] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:49.905292 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942d887-fa62-4c08-bd24-0d014cffc7fc None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:49.918847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942d887-fa62-4c08-bd24-0d014cffc7fc None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:49.927992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:49.929051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.929339 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.929679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.930429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:10:49.930742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:49.932614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:49.950723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1200/2358] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:10:49.955127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4c26-857d-4232-a4c9-c4047e39410d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:49.966329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d4c26-857d-4232-a4c9-c4047e39410d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:49.971121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:49.972404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.972688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.973134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.973886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:49.975805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:50.010502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1159/2359] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:10:49 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:10:50.011706 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:50.023589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a383ef7-13d1-4c88-bfed-c93c5e4fad71 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:50.103910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:50.104584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:50.104866 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:50.105142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:50.105924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:50.108039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:50.131264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1201/2360] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:10:50 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:10:50.135797 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:50.147828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107dded-9931-4d7b-9b45-97e07cc3e39b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:50.152583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:50.153245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:50.153548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:50.153822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:50.155183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:50.156438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:50.174570 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1160/2361] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:10:50.179007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:50.193181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e864e-72c9-4955-8237-0502d7f05ab9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:50.198671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057d8a6-5374-4a49-8fe7-558c39528f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:50.199350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057d8a6-5374-4a49-8fe7-558c39528f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:50.199638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057d8a6-5374-4a49-8fe7-558c39528f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:50.200114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057d8a6-5374-4a49-8fe7-558c39528f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:50.200972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057d8a6-5374-4a49-8fe7-558c39528f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:50.203182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d057d8a6-5374-4a49-8fe7-558c39528f32 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:50.223281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1202/2362] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:10:50.228466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:50.245835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc0c47-e730-4815-9e5e-c51c97affbe7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:50.251662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:50.253045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:50.253531 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:50.253983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] PATH_INFO: `/v3/projects/9cf4876eaa6b488086bd662141842048/users/66f6dded80a54977b2a95bcf39874daa/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:50.283962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf4876eaa6b488086bd662141842048, user_id=66f6dded80a54977b2a95bcf39874daa, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:50.287365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:50.304482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1161/2363] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:10:50 2022] PUT /identity/v3/projects/9cf4876eaa6b488086bd662141842048/users/66f6dded80a54977b2a95bcf39874daa/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:10:50.315652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e43b55-5187-45cb-96d7-d561206b9d92 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:50.316042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e43b55-5187-45cb-96d7-d561206b9d92 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:50.316234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e43b55-5187-45cb-96d7-d561206b9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:50.349564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-03e43b55-5187-45cb-96d7-d561206b9d92 None None] MFA Rules not processed for user `66f6dded80a54977b2a95bcf39874daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:50.350784 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-03e43b55-5187-45cb-96d7-d561206b9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:50.361180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:50.429779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1203/2364] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:10:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:50.441608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:50.444141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:50.509260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08efe8f-aa89-4675-b0a4-cc9d107677b3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:50.512877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebb439-2c9f-42b7-9648-e3e3e9df2213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:50.513563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebb439-2c9f-42b7-9648-e3e3e9df2213 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:50.513852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebb439-2c9f-42b7-9648-e3e3e9df2213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:50.514132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebb439-2c9f-42b7-9648-e3e3e9df2213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:50.523269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebb439-2c9f-42b7-9648-e3e3e9df2213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:50.524699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebb439-2c9f-42b7-9648-e3e3e9df2213 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:50.533610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1162/2365] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:00.426387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=22 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:00.529559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:01.869981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e43b55-5187-45cb-96d7-d561206b9d92 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:01.931782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e43b55-5187-45cb-96d7-d561206b9d92 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:01.936307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:01.937475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:01.937718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:01.937996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] PATH_INFO: `/v3/users/66f6dded80a54977b2a95bcf39874daa` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:01.939327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f6dded80a54977b2a95bcf39874daa)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:01.941325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:01.986462 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f6dded80a54977b2a95bcf39874daa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:01.993943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f6dded80a54977b2a95bcf39874daa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:01.994567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f6dded80a54977b2a95bcf39874daa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.006967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f6dded80a54977b2a95bcf39874daa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.007603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f6dded80a54977b2a95bcf39874daa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.020698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1204/2366] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:11:01 2022] DELETE /identity/v3/users/66f6dded80a54977b2a95bcf39874daa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:02.025278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.025832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.025952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.043726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:02.044921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:02.106006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1163/2367] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:02.116958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.118475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:02.177472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d7bf5-8a2e-462f-a98b-502410196874 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.182327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f69305-60db-4874-9b3a-981894beec00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.183090 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69305-60db-4874-9b3a-981894beec00 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.183561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69305-60db-4874-9b3a-981894beec00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.183943 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69305-60db-4874-9b3a-981894beec00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.194661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f69305-60db-4874-9b3a-981894beec00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:02.196275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f69305-60db-4874-9b3a-981894beec00 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:02.206049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1205/2368] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:02.484720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.486192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:02.497920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aea81d-e6ca-4b71-a63e-51cd602fe955 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.503365 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.504378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.504673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.505073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] PATH_INFO: `/v3/projects/9cf4876eaa6b488086bd662141842048` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.506400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf4876eaa6b488086bd662141842048)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:02.508402 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:02.559435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf4876eaa6b488086bd662141842048', 'request_id': 'req-cfc16e99-8d62-4af7-9674-43389ee50f1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.567026 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf4876eaa6b488086bd662141842048', 'request_id': 'req-cfc16e99-8d62-4af7-9674-43389ee50f1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.572874 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf4876eaa6b488086bd662141842048', 'request_id': 'req-cfc16e99-8d62-4af7-9674-43389ee50f1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.584676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] The token cache is being invalidate because project 9cf4876eaa6b488086bd662141842048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:11:02.584956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.585608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cfc16e99-8d62-4af7-9674-43389ee50f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:02.587256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1164/2369] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:11:02 2022] DELETE /identity/v3/projects/9cf4876eaa6b488086bd662141842048 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:02.592253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9be92-fba0-415d-b9f9-3766f8da72ae None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.592540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9be92-fba0-415d-b9f9-3766f8da72ae None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.592826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9be92-fba0-415d-b9f9-3766f8da72ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.611512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-67e9be92-fba0-415d-b9f9-3766f8da72ae None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:02.612884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-67e9be92-fba0-415d-b9f9-3766f8da72ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:02.630387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:02.676537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1206/2370] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:02.684050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680eac6-da69-4bb9-832e-c34dab171caf None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.684342 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680eac6-da69-4bb9-832e-c34dab171caf None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.684623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680eac6-da69-4bb9-832e-c34dab171caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.702835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7680eac6-da69-4bb9-832e-c34dab171caf None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:02.704041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7680eac6-da69-4bb9-832e-c34dab171caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:02.712902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1165/2371] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:02.716955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9be92-fba0-415d-b9f9-3766f8da72ae None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.727253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9be92-fba0-415d-b9f9-3766f8da72ae None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.731727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.732383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.732647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.732918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.733669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:11:02.733972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:02.735584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:02.747157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1207/2372] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:11:02.751325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680eac6-da69-4bb9-832e-c34dab171caf None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.761188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680eac6-da69-4bb9-832e-c34dab171caf None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.765842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.766488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.766774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.767053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.768413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:02.770492 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:02.798923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1166/2373] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:11:02 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:11:02.800290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.810380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556c1eb-a616-4eb4-aadb-ead0c19170ef admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.872725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.873419 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.873733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.874011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.874709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:02.876635 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:02.902261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1208/2374] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:11:02 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:11:02.903395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.913801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b8e5d-8f53-4dbc-9a66-7228f187f4f9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.918709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.919446 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.919661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.919953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.920755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:02.922420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:02.932997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1167/2375] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:02.937100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.948098 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a30223-7b13-440c-8a7d-0929437b59c5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.952709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18348779-895c-4566-8a24-d9e8125a1396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.953393 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348779-895c-4566-8a24-d9e8125a1396 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.953755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348779-895c-4566-8a24-d9e8125a1396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.954030 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348779-895c-4566-8a24-d9e8125a1396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:02.954778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18348779-895c-4566-8a24-d9e8125a1396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:02.957012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18348779-895c-4566-8a24-d9e8125a1396 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:02.967713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1209/2376] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:02.971863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:02.981754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be94e-741b-4dfc-80d1-7556fdc2fad2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:02.986748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:02.987630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:02.987915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:02.988194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] PATH_INFO: `/v3/projects/645eb1c9b52145aaa72e6a4b92d3996f/users/69e4f43bf52f41d8bded1f72b271cb4d/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:03.003094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645eb1c9b52145aaa72e6a4b92d3996f, user_id=69e4f43bf52f41d8bded1f72b271cb4d, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:03.005848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:03.018949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1168/2377] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:11:02 2022] PUT /identity/v3/projects/645eb1c9b52145aaa72e6a4b92d3996f/users/69e4f43bf52f41d8bded1f72b271cb4d/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:03.024072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbeea0-4399-4f85-a0cd-673450ae9c9f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:03.024358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbeea0-4399-4f85-a0cd-673450ae9c9f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:03.024633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbeea0-4399-4f85-a0cd-673450ae9c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:03.042778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7dbbeea0-4399-4f85-a0cd-673450ae9c9f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:03.044026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7dbbeea0-4399-4f85-a0cd-673450ae9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:03.105106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1210/2378] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:03.116542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:03.118264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:03.144676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:03.181501 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f448b0c-06ab-45c3-8db6-c1f0ddedd935 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:03.185178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:03.185853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:03.186137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:03.186413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:03.196480 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:03.197966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:03.208113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1169/2379] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:07.359974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0841-e9e5-47e6-9599-689cc1bcc14d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:07.360482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0841-e9e5-47e6-9599-689cc1bcc14d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:07.360482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e0841-e9e5-47e6-9599-689cc1bcc14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:07.394801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3b8e0841-e9e5-47e6-9599-689cc1bcc14d None None] MFA Rules not processed for user `69e4f43bf52f41d8bded1f72b271cb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:07.396133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3b8e0841-e9e5-47e6-9599-689cc1bcc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:07.414679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:07.467740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1211/2380] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:07.473546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:07.486040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad940-73ac-41bb-9b53-68ef24098092 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:07.496528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:07.502617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:07.503030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:07.503547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:07.504773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:07.506889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:07.559853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1170/2381] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:11:07 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:11:07.561591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e0841-e9e5-47e6-9599-689cc1bcc14d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:07.575241 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e0841-e9e5-47e6-9599-689cc1bcc14d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:07.640112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:07.640799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:07.641084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:07.641402 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:07.642122 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:07.645069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:07.667031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1212/2382] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:11:07 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:11:07.670921 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:07.685571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4fe74-c5f3-4213-8575-d629bf01befc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:07.691558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:07.692352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:07.692646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:07.692927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:07.693756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:07.695419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:07.709544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1171/2383] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:07.714505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:07.726178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb037c-d47b-4158-97f3-2928538ba882 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:07.731049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:07.731952 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:07.732237 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:07.732514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] PATH_INFO: `/v3/projects/cec9f551240b42bc9f610a1f2dc1e5eb/users/497a3f4c07344f278d0a13a719e30290/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:07.750256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec9f551240b42bc9f610a1f2dc1e5eb, user_id=497a3f4c07344f278d0a13a719e30290, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:07.754025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:07.768816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1213/2384] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:11:07 2022] PUT /identity/v3/projects/cec9f551240b42bc9f610a1f2dc1e5eb/users/497a3f4c07344f278d0a13a719e30290/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:07.772816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:07.784801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4c80a-a914-4cb1-98c5-3481679c3237 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:07.850289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480ca34-673d-4c9e-bb00-2818ce8266ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:07.851111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ca34-673d-4c9e-bb00-2818ce8266ec admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:07.851403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ca34-673d-4c9e-bb00-2818ce8266ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:07.851682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480ca34-673d-4c9e-bb00-2818ce8266ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:07.852426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480ca34-673d-4c9e-bb00-2818ce8266ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:07.854079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480ca34-673d-4c9e-bb00-2818ce8266ec admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:07.867884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1172/2385] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:07.869071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:07.880937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18217d0b-381f-40e5-bdfa-136f53919446 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:07.885849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:07.886739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:07.887020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:07.887295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] PATH_INFO: `/v3/projects/cec9f551240b42bc9f610a1f2dc1e5eb/users/497a3f4c07344f278d0a13a719e30290/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:07.889773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec9f551240b42bc9f610a1f2dc1e5eb, user_id=497a3f4c07344f278d0a13a719e30290, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:07.893561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:07.907515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1214/2386] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:11:07 2022] PUT /identity/v3/projects/cec9f551240b42bc9f610a1f2dc1e5eb/users/497a3f4c07344f278d0a13a719e30290/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:13.052262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d622e-9b56-44c6-885c-84e2ccfa9e2f None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:13.053170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d622e-9b56-44c6-885c-84e2ccfa9e2f None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:13.053639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d622e-9b56-44c6-885c-84e2ccfa9e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:13.092736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2d0d622e-9b56-44c6-885c-84e2ccfa9e2f None None] MFA Rules not processed for user `497a3f4c07344f278d0a13a719e30290`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:13.094008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2d0d622e-9b56-44c6-885c-84e2ccfa9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:13.189461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1173/2387] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:13.206645 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:13.209172 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:13.297840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2277556-ee24-42de-a2b9-e8bf6eb79d71 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:13.304745 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1245d6d-afbe-4e63-b173-65f73f046941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:13.306048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245d6d-afbe-4e63-b173-65f73f046941 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:13.306342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245d6d-afbe-4e63-b173-65f73f046941 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:13.306629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1245d6d-afbe-4e63-b173-65f73f046941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:13.320379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:13.359685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:13.359980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:13.360292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:13.382395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] MFA Rules not processed for user `ab8bc4faa499494f93571797e3c89e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:13.383658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:13.388877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:13.391563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245d6d-afbe-4e63-b173-65f73f046941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:13.393452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1245d6d-afbe-4e63-b173-65f73f046941 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:13.404052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1215/2388] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:13.463362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1174/2389] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:11:14.744217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:14.745209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:14.745520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:14.768609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] MFA Rules not processed for user `69e4f43bf52f41d8bded1f72b271cb4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:14.769975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:14.778727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1216/2390] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:14.871396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:14.872906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:14.976568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87537bd9-031c-4897-99e6-e9e25a53a505 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:14.982876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab210-b9f9-49bd-888d-68669c06a539 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:14.983908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab210-b9f9-49bd-888d-68669c06a539 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:14.989374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab210-b9f9-49bd-888d-68669c06a539 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:14.989659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab210-b9f9-49bd-888d-68669c06a539 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:14.994864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-889ab210-b9f9-49bd-888d-68669c06a539 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:15.011444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab210-b9f9-49bd-888d-68669c06a539 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:15.014235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab210-b9f9-49bd-888d-68669c06a539 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:15.027122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1175/2391] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:24.761646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=27 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:24.911701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:24.913120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:24.978788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76cbaa-9fce-4a2d-be29-0e367cd58a1e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:24.983573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:24.984449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:24.984729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:24.985003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] PATH_INFO: `/v3/users/f3e94f649d30435e81cf210a52092e7d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:24.986394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e94f649d30435e81cf210a52092e7d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:24.988343 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:25.022355 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=52 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:25.036544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e94f649d30435e81cf210a52092e7d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.043538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e94f649d30435e81cf210a52092e7d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.044162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e94f649d30435e81cf210a52092e7d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.056311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e94f649d30435e81cf210a52092e7d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.056958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e94f649d30435e81cf210a52092e7d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.069588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1217/2392] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:11:24 2022] DELETE /identity/v3/users/f3e94f649d30435e81cf210a52092e7d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:25.074052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.074368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.074648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.094016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:25.095223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:25.156954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1176/2393] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:25.166707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:25.168108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:25.229598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cc413-24aa-4298-a236-3659b85a4271 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:25.233458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924f7a8-4df1-4fa9-84fb-18a12680064b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:25.234311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924f7a8-4df1-4fa9-84fb-18a12680064b service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.234699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924f7a8-4df1-4fa9-84fb-18a12680064b service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.235083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924f7a8-4df1-4fa9-84fb-18a12680064b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.245730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924f7a8-4df1-4fa9-84fb-18a12680064b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:25.247159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924f7a8-4df1-4fa9-84fb-18a12680064b service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:25.256845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1218/2394] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:25.546251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:25.547745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:25.562005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa0906-7615-4c69-b73d-02a1d70265c4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:25.566732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:25.567596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.567875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.568174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] PATH_INFO: `/v3/projects/1098e2703d7343a59318309d79fd8032` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.569374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1098e2703d7343a59318309d79fd8032)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:25.571295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:25.620830 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1098e2703d7343a59318309d79fd8032', 'request_id': 'req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.628579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1098e2703d7343a59318309d79fd8032', 'request_id': 'req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.635309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1098e2703d7343a59318309d79fd8032', 'request_id': 'req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.646997 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] The token cache is being invalidate because project 1098e2703d7343a59318309d79fd8032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:11:25.647299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.647943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-bddea61f-6cc3-4f27-b0da-7c0c7d328b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:25.650213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1177/2395] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:11:25 2022] DELETE /identity/v3/projects/1098e2703d7343a59318309d79fd8032 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:25.656187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a06cb6-303f-4a79-9849-2a678f714bc7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.657131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a06cb6-303f-4a79-9849-2a678f714bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.657626 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a06cb6-303f-4a79-9849-2a678f714bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.678361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c1a06cb6-303f-4a79-9849-2a678f714bc7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:25.679463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c1a06cb6-303f-4a79-9849-2a678f714bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:25.696202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:25.744109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1219/2396] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:25.754333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531488b-278b-4e73-9410-bf3e21075302 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.754609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531488b-278b-4e73-9410-bf3e21075302 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.754885 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531488b-278b-4e73-9410-bf3e21075302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.773840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9531488b-278b-4e73-9410-bf3e21075302 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:25.775032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9531488b-278b-4e73-9410-bf3e21075302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:25.783814 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1178/2397] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:25.788488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a06cb6-303f-4a79-9849-2a678f714bc7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:25.798149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a06cb6-303f-4a79-9849-2a678f714bc7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:25.802955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:25.803604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.803883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.804161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.804876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:11:25.805179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:25.806793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:25.818684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1220/2398] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:11:25.822923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531488b-278b-4e73-9410-bf3e21075302 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:25.834095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531488b-278b-4e73-9410-bf3e21075302 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:25.841109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:25.841839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.842111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.842409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.843108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:25.845388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:25.888114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1179/2399] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:11:25 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:11:25.889245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:25.903892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8200d39-db34-4383-a4fe-2978e308d9e5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:25.964133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:25.964818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.965100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.965405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.966130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:25.968056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:25.988062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1221/2400] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:11:25 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:11:25.992996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:26.006798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349b685-d456-4149-bc78-b373e6f46582 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:26.011772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:26.012405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:26.012690 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:26.012967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:26.013954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:26.015744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:26.027397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1180/2401] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:26.031168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:26.041297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc557a-02ef-49c4-8009-c6ca24e173d1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:26.046081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab2af4-fce0-4eba-b496-7abf3dcc93fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:26.046736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2af4-fce0-4eba-b496-7abf3dcc93fa admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:26.047022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2af4-fce0-4eba-b496-7abf3dcc93fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:26.047304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab2af4-fce0-4eba-b496-7abf3dcc93fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:26.048031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab2af4-fce0-4eba-b496-7abf3dcc93fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:26.049840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab2af4-fce0-4eba-b496-7abf3dcc93fa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:26.060427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1222/2402] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:26.065537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:26.075790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a044c3f-fedb-46c7-b7a1-435512155671 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:26.081321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:26.082399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:26.082680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:26.082953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] PATH_INFO: `/v3/projects/f8d7e89e756c41e3a116df5b1d5b5a27/users/d13329b9c7ae4e6980560ba341ece0d0/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:26.099292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d7e89e756c41e3a116df5b1d5b5a27, user_id=d13329b9c7ae4e6980560ba341ece0d0, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:26.102044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:26.116546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1181/2403] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:11:26 2022] PUT /identity/v3/projects/f8d7e89e756c41e3a116df5b1d5b5a27/users/d13329b9c7ae4e6980560ba341ece0d0/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:26.130600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf84f-38fa-4501-9f3c-fc203cb95f9d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:26.131042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf84f-38fa-4501-9f3c-fc203cb95f9d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:26.131424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf84f-38fa-4501-9f3c-fc203cb95f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:26.159367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-57adf84f-38fa-4501-9f3c-fc203cb95f9d None None] MFA Rules not processed for user `d13329b9c7ae4e6980560ba341ece0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:26.160589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-57adf84f-38fa-4501-9f3c-fc203cb95f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:26.226069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1223/2404] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:26.237367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:26.239399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:26.261418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:26.304584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fcd31f-cba7-4a0c-8125-b325d135415f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:26.308308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474f26-1ae0-4f4e-ac69-55178033f657 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:26.308963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474f26-1ae0-4f4e-ac69-55178033f657 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:26.309266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474f26-1ae0-4f4e-ac69-55178033f657 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:26.309566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474f26-1ae0-4f4e-ac69-55178033f657 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:26.318218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474f26-1ae0-4f4e-ac69-55178033f657 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:26.319657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474f26-1ae0-4f4e-ac69-55178033f657 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:26.328429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1182/2405] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:28.742316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:28.742860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:28.742969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:28.761768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] MFA Rules not processed for user `d13329b9c7ae4e6980560ba341ece0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:28.762985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:28.770695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1224/2406] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:36.324479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=17 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:38.756350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:51.721463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad71bb-669a-4027-a46a-f73afd31391b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:51.722033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad71bb-669a-4027-a46a-f73afd31391b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:51.722033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad71bb-669a-4027-a46a-f73afd31391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:51.739208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9cad71bb-669a-4027-a46a-f73afd31391b None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:51.740410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9cad71bb-669a-4027-a46a-f73afd31391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:51.801516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1183/2407] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:51.849851 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:51.851251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:51.922059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce97e2-a9fb-4c69-98ee-fa14c4a3911f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:51.927297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:51.927892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:51.928847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:51.929271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:51.937884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:51.939653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:51.947633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1225/2408] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:11:52.460226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf176c7-49b6-4fa4-8f7d-e39e22b0c882 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:52.460523 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf176c7-49b6-4fa4-8f7d-e39e22b0c882 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:52.460807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf176c7-49b6-4fa4-8f7d-e39e22b0c882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:52.478837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-adf176c7-49b6-4fa4-8f7d-e39e22b0c882 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:52.480049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-adf176c7-49b6-4fa4-8f7d-e39e22b0c882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:52.487255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1184/2409] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:52.505013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:52.515676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a5d70-d61a-4a16-93a6-a73f9ce89206 service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:52.521559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:52.522210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:52.522495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:52.522776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:52.531388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:52.533040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:52.541893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1226/2410] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:11:52.754250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa4401-5a13-44c3-a8cc-1530d1ee459c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:52.754766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa4401-5a13-44c3-a8cc-1530d1ee459c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:52.754865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa4401-5a13-44c3-a8cc-1530d1ee459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:52.772879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-22aa4401-5a13-44c3-a8cc-1530d1ee459c None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:52.774100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-22aa4401-5a13-44c3-a8cc-1530d1ee459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:52.781276 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1185/2411] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:52.794136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:52.805630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b334b-bc8b-486a-bdc7-49c1838ff49d service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:52.811083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:52.811721 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:52.812003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:52.812280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:52.822307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:52.823902 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:52.832207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1227/2412] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:11:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:11:53.158108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99f07-d92d-43ba-b178-fa2dbdf1963b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:53.158398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99f07-d92d-43ba-b178-fa2dbdf1963b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:53.158679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d99f07-d92d-43ba-b178-fa2dbdf1963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:53.176100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-29d99f07-d92d-43ba-b178-fa2dbdf1963b None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:53.177315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-29d99f07-d92d-43ba-b178-fa2dbdf1963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:53.184424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1186/2413] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:53.197253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:53.209535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce29d30-9579-42b7-9aeb-d2d835a5418a service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:53.214547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f3348-fa08-4029-92bc-2caefce3238e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:53.215190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3348-fa08-4029-92bc-2caefce3238e service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:53.215477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3348-fa08-4029-92bc-2caefce3238e service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:53.215754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f3348-fa08-4029-92bc-2caefce3238e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:53.224668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f3348-fa08-4029-92bc-2caefce3238e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:53.226273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f3348-fa08-4029-92bc-2caefce3238e service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:53.234510 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1228/2414] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:11:55.371245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99f07-d92d-43ba-b178-fa2dbdf1963b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:55.437927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d99f07-d92d-43ba-b178-fa2dbdf1963b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:55.443374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:55.444263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:55.444546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:55.444824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] PATH_INFO: `/v3/users/d13329b9c7ae4e6980560ba341ece0d0` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:55.446147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13329b9c7ae4e6980560ba341ece0d0)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:55.448429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:55.500168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13329b9c7ae4e6980560ba341ece0d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.508640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13329b9c7ae4e6980560ba341ece0d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.509411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13329b9c7ae4e6980560ba341ece0d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.510172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13329b9c7ae4e6980560ba341ece0d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.518500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13329b9c7ae4e6980560ba341ece0d0'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.540721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1187/2415] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:11:55 2022] DELETE /identity/v3/users/d13329b9c7ae4e6980560ba341ece0d0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:55.542478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:55.542928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:55.543023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:55.561759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:55.562985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:55.625504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1229/2416] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:55.635436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:55.636860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:55.643986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:55.696058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b97253-df86-4851-b88a-fc6d0c43537d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:55.699697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64383af5-0d38-4df4-b0ba-454f6bdbf35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:55.700356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383af5-0d38-4df4-b0ba-454f6bdbf35b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:55.700618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383af5-0d38-4df4-b0ba-454f6bdbf35b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:55.700890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64383af5-0d38-4df4-b0ba-454f6bdbf35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:55.710423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64383af5-0d38-4df4-b0ba-454f6bdbf35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:55.711835 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64383af5-0d38-4df4-b0ba-454f6bdbf35b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:55.721903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1188/2417] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:55.895684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:55.897701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:55.910535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeeb771-cac5-4e6f-b8d2-492caf39bac7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:55.915243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:55.916110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:55.916390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:55.916664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] PATH_INFO: `/v3/projects/f8d7e89e756c41e3a116df5b1d5b5a27` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:55.917963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d7e89e756c41e3a116df5b1d5b5a27)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:55.919879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:55.967585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:55.971034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d7e89e756c41e3a116df5b1d5b5a27', 'request_id': 'req-6cf0df13-212b-4be8-8433-2a5b2e797da6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.976813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d7e89e756c41e3a116df5b1d5b5a27', 'request_id': 'req-6cf0df13-212b-4be8-8433-2a5b2e797da6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.984056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d7e89e756c41e3a116df5b1d5b5a27', 'request_id': 'req-6cf0df13-212b-4be8-8433-2a5b2e797da6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.995799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] The token cache is being invalidate because project f8d7e89e756c41e3a116df5b1d5b5a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:11:55.996093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.996765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-6cf0df13-212b-4be8-8433-2a5b2e797da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:11:55.998374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1230/2418] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:11:55 2022] DELETE /identity/v3/projects/f8d7e89e756c41e3a116df5b1d5b5a27 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:56.004330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4bc10-cecb-4e9d-8081-e9140c46c3ac None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.004620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4bc10-cecb-4e9d-8081-e9140c46c3ac None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.004901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4bc10-cecb-4e9d-8081-e9140c46c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.023040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8aa4bc10-cecb-4e9d-8081-e9140c46c3ac None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:56.024254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8aa4bc10-cecb-4e9d-8081-e9140c46c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:56.089698 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1189/2419] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:56.097600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8e5b-346c-463d-8a61-76664ee8870f None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.097907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8e5b-346c-463d-8a61-76664ee8870f None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.098171 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8e5b-346c-463d-8a61-76664ee8870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.116610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-267a8e5b-346c-463d-8a61-76664ee8870f None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:56.117864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-267a8e5b-346c-463d-8a61-76664ee8870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:56.127516 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1231/2420] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:56.131754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4bc10-cecb-4e9d-8081-e9140c46c3ac None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.150822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4bc10-cecb-4e9d-8081-e9140c46c3ac None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.156305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.157112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.157872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.158235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.159051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:11:56.159434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.161125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.175512 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1190/2421] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:11:56.180106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a8e5b-346c-463d-8a61-76664ee8870f None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.190794 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a8e5b-346c-463d-8a61-76664ee8870f None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.195746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.196447 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.196729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.197054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.198147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.199712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.233633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1232/2422] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:11:56 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:11:56.234922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.245470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d89f-d6b6-42ab-88ef-612cea429737 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.305535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.306453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.306732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.307008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.307699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.309894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.333867 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1191/2423] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:11:56 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:11:56.335196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.347713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed82750-9c52-41d7-828f-db084017d75c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.352456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.353119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.353456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.353718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.354433 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.356036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.367563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1233/2424] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:56.371853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.383003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaee618-ab1b-4001-8265-c4eab1068aaf admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.387618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78069f5-7097-43d8-abec-3ce1e275c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.388282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78069f5-7097-43d8-abec-3ce1e275c4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.388564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78069f5-7097-43d8-abec-3ce1e275c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.388836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78069f5-7097-43d8-abec-3ce1e275c4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.389591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78069f5-7097-43d8-abec-3ce1e275c4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.391181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78069f5-7097-43d8-abec-3ce1e275c4d9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.402224 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1192/2425] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:56.406422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.417121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29448b0-e43c-467b-a04b-c1e34f9299ae admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.421811 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.422686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.423441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.423739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] PATH_INFO: `/v3/projects/5db59433c79e4006987a047747f60020/users/f71924f4c69e40599c19aedbde756bcc/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.439047 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db59433c79e4006987a047747f60020, user_id=f71924f4c69e40599c19aedbde756bcc, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.441877 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.455893 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1234/2426] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:11:56 2022] PUT /identity/v3/projects/5db59433c79e4006987a047747f60020/users/f71924f4c69e40599c19aedbde756bcc/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:11:56.461295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a00552-6483-4137-ab96-ebc9bd1fadb8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.461697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a00552-6483-4137-ab96-ebc9bd1fadb8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.461992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a00552-6483-4137-ab96-ebc9bd1fadb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.480362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-71a00552-6483-4137-ab96-ebc9bd1fadb8 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:56.481608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-71a00552-6483-4137-ab96-ebc9bd1fadb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:56.490185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:56.543845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1193/2427] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:56.553422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.555312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:56.612992 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae8c72-4d00-495f-b061-3033753f764a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.616722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.617916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.617916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.617916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.627354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.628788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.638500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1235/2428] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:01.126670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dd3a8-fc5c-4ff6-8784-c5fa6dcf5353 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.127623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dd3a8-fc5c-4ff6-8784-c5fa6dcf5353 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.128088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dd3a8-fc5c-4ff6-8784-c5fa6dcf5353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.177644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-424dd3a8-fc5c-4ff6-8784-c5fa6dcf5353 None None] MFA Rules not processed for user `f71924f4c69e40599c19aedbde756bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:12:01.179030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-424dd3a8-fc5c-4ff6-8784-c5fa6dcf5353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:01.251745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1194/2429] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:12:01.256094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:01.279346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd68b-9e60-4d5b-8b56-81a35f6cbf96 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:01.287236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:01.287917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.288206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.288488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.289198 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:01.292591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:01.326509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1236/2430] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:12:01 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:12:01.330876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dd3a8-fc5c-4ff6-8784-c5fa6dcf5353 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:01.342389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dd3a8-fc5c-4ff6-8784-c5fa6dcf5353 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:01.406692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:01.407935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.408260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.408594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.409318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:01.411297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:01.436669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1195/2431] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:12:01 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:12:01.437995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:01.450549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f9746-9d8a-40a8-b4c4-262a806099d5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:01.455630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:01.456311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.456574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.456856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.457621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:01.459231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:01.471939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1237/2432] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:12:01.476471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:01.487328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fd82-a747-425c-892c-b76a39fed15e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:01.492179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:01.493113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.493425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.493708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] PATH_INFO: `/v3/projects/bf9b35cc921346fa884869f9f20f72ab/users/9d25d8c43615403a84ecf530b2731060/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.510465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9b35cc921346fa884869f9f20f72ab, user_id=9d25d8c43615403a84ecf530b2731060, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:01.513945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:01.531130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1196/2433] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:12:01 2022] PUT /identity/v3/projects/bf9b35cc921346fa884869f9f20f72ab/users/9d25d8c43615403a84ecf530b2731060/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:12:01.535841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:01.546340 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000793-78bd-4c86-9885-3d72e6f6afb6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:01.588224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:01.616525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:01.617128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.617493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.617800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.618773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:01.620962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:01.637473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1238/2434] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:12:01.638593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:01.651906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246183b-0185-4bfc-8c39-ab836f952e88 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:01.657896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e476cba-576b-4df4-b265-1b209d4926f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:01.658807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e476cba-576b-4df4-b265-1b209d4926f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.659084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e476cba-576b-4df4-b265-1b209d4926f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.659356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e476cba-576b-4df4-b265-1b209d4926f1 admin admin] PATH_INFO: `/v3/projects/bf9b35cc921346fa884869f9f20f72ab/users/9d25d8c43615403a84ecf530b2731060/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.661508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e476cba-576b-4df4-b265-1b209d4926f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9b35cc921346fa884869f9f20f72ab, user_id=9d25d8c43615403a84ecf530b2731060, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:01.664193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e476cba-576b-4df4-b265-1b209d4926f1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:01.667919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:01.682293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1197/2435] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:12:01 2022] PUT /identity/v3/projects/bf9b35cc921346fa884869f9f20f72ab/users/9d25d8c43615403a84ecf530b2731060/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:12:02.768564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:02.837707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140014-d998-4ba6-b59c-59d326bcc26b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:02.902756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:02.903430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:02.903869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:02.904206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:02.907768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:03.036376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:03.038152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:03.059174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1239/2436] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:07.008622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27510b4-d63e-4d81-9672-1df26da3f5f5 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:07.009538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27510b4-d63e-4d81-9672-1df26da3f5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:07.009823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27510b4-d63e-4d81-9672-1df26da3f5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:07.041482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a27510b4-d63e-4d81-9672-1df26da3f5f5 None None] MFA Rules not processed for user `9d25d8c43615403a84ecf530b2731060`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:12:07.042703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a27510b4-d63e-4d81-9672-1df26da3f5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:07.128063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1198/2437] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:12:07.140689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:07.143153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:07.189243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:07.202564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83acfb-4f26-42fb-b29b-51c015069bcb service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:07.206554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:07.207346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:07.207627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:07.207900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:07.270609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:07.272135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:07.283006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1240/2438] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:12:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:07.392529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752353d-d165-480d-8ed6-3977733e2a5c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:07.393589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752353d-d165-480d-8ed6-3977733e2a5c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:07.393877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752353d-d165-480d-8ed6-3977733e2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:07.412660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d752353d-d165-480d-8ed6-3977733e2a5c None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:12:07.413856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d752353d-d165-480d-8ed6-3977733e2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:07.474161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1199/2439] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:12:07.486463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:07.487884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:07.570512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25440df4-1c73-44f6-b7fc-66d0aa14db46 service glance] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:07.575705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60f70b-eae5-45db-bbf4-1048362a3b87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:07.576382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60f70b-eae5-45db-bbf4-1048362a3b87 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:07.576636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60f70b-eae5-45db-bbf4-1048362a3b87 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:07.576906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60f70b-eae5-45db-bbf4-1048362a3b87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:07.585428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60f70b-eae5-45db-bbf4-1048362a3b87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:07.587056 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60f70b-eae5-45db-bbf4-1048362a3b87 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:07.595269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1241/2440] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 14:12:16.505445 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2363-23c2-4274-96fb-f175d46d6595 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:16.506006 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2363-23c2-4274-96fb-f175d46d6595 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:16.506144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2363-23c2-4274-96fb-f175d46d6595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:16.523968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-401f2363-23c2-4274-96fb-f175d46d6595 None None] MFA Rules not processed for user `f71924f4c69e40599c19aedbde756bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:12:16.525268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-401f2363-23c2-4274-96fb-f175d46d6595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:16.532966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1200/2441] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:12:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:12:17.591807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=61 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:18.730878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:18.731458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:18.731458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:18.749903 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:12:18.751362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:18.759087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1242/2442] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:12:18.771954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f2363-23c2-4274-96fb-f175d46d6595 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:18.784725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f2363-23c2-4274-96fb-f175d46d6595 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:18.791746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:18.792560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:18.792846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:18.793168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:18.802910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:18.804524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:18.813463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1201/2443] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:12:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:12:28.744588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:28.809648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=70 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:52.024314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:52.025915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:52.038924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b75510-aeaa-4d07-80f5-5ae5a79dfe67 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:52.046580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:52.047931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:52.048218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:52.048578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:52.050631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:52.144541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:52.146087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:52.158471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1243/2444] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:12:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:55.147027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:55.156646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401945a-663e-4ba6-b48f-cbb3236c13d4 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:55.160310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0c5f1-4404-40a6-b9f5-fb59b2985ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:55.160957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c5f1-4404-40a6-b9f5-fb59b2985ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:55.161260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c5f1-4404-40a6-b9f5-fb59b2985ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:55.161555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0c5f1-4404-40a6-b9f5-fb59b2985ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:55.163321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-45f0c5f1-4404-40a6-b9f5-fb59b2985ec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:55.177438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0c5f1-4404-40a6-b9f5-fb59b2985ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:55.179073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0c5f1-4404-40a6-b9f5-fb59b2985ec0 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:55.191223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1202/2445] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:58.158871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:58.167556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dfd9e-ac51-47c4-8e75-7e098430d4bf service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:58.171110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:58.172265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:58.172539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:58.172807 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:58.183506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:58.184928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:58.195679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1244/2446] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:12:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:05.185662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:07.713470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:07.714040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:07.714040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:07.733159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:07.734443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:07.742549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1203/2447] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:07.770989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:07.782691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5eb90-4921-440b-91ff-21b7ae52255d service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:07.787932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:07.788567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:07.788844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:07.789114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:07.797507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:07.799070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:07.807392 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1245/2448] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:13:12.229781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:12.231237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:12.247794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2be9d-e7eb-4615-8bd6-abd49209ce22 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:12.254714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b73d6-43e6-4a53-8635-8e9cc2096a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:12.255692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b73d6-43e6-4a53-8635-8e9cc2096a77 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:12.255974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b73d6-43e6-4a53-8635-8e9cc2096a77 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:12.256250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b73d6-43e6-4a53-8635-8e9cc2096a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:12.258081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca2b73d6-43e6-4a53-8635-8e9cc2096a77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:12.339704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b73d6-43e6-4a53-8635-8e9cc2096a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:12.341307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b73d6-43e6-4a53-8635-8e9cc2096a77 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:12.355147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1204/2449] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:17.803886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=46 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:22.346812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=31 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:25.762723 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:25.772655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da264b0-4d64-4b3d-8be3-42b7d267f5cc service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:25.776229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd240ae-ba25-4c01-a4b9-d2eeafa20469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:25.776867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd240ae-ba25-4c01-a4b9-d2eeafa20469 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:25.777152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd240ae-ba25-4c01-a4b9-d2eeafa20469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:25.777465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd240ae-ba25-4c01-a4b9-d2eeafa20469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:25.779573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3fd240ae-ba25-4c01-a4b9-d2eeafa20469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:25.789525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd240ae-ba25-4c01-a4b9-d2eeafa20469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:25.790958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd240ae-ba25-4c01-a4b9-d2eeafa20469 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:25.799547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1246/2450] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:25.906630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e430f-9411-41f7-a0f3-62679859451a None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:25.907211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e430f-9411-41f7-a0f3-62679859451a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:25.907211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e430f-9411-41f7-a0f3-62679859451a None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:25.908648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1205/2451] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:13:25.915537 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f615af-c028-4999-b21a-b07cb900e8af None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:25.915914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f615af-c028-4999-b21a-b07cb900e8af None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:25.916256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f615af-c028-4999-b21a-b07cb900e8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:25.937038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-c1f615af-c028-4999-b21a-b07cb900e8af None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:25.938551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-c1f615af-c028-4999-b21a-b07cb900e8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:25.948036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1247/2452] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:13:25.960893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e430f-9411-41f7-a0f3-62679859451a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:25.972213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e430f-9411-41f7-a0f3-62679859451a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:25.975767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d57d78-cd97-41dc-945b-9773545f44e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:25.976491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d57d78-cd97-41dc-945b-9773545f44e9 service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:25.976863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d57d78-cd97-41dc-945b-9773545f44e9 service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:25.977203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d57d78-cd97-41dc-945b-9773545f44e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:25.989748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d57d78-cd97-41dc-945b-9773545f44e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:25.991246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d57d78-cd97-41dc-945b-9773545f44e9 service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:26.003055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1206/2453] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:26.070141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861bd18-35b2-41ab-9220-71653beff804 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:26.070431 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861bd18-35b2-41ab-9220-71653beff804 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:26.070707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861bd18-35b2-41ab-9220-71653beff804 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:26.072209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1248/2454] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:13:26.077232 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c25f-1f9c-4a66-b1bb-0cc96f25d27d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:26.077556 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c25f-1f9c-4a66-b1bb-0cc96f25d27d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:26.077831 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1c25f-1f9c-4a66-b1bb-0cc96f25d27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:26.096095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6fe1c25f-1f9c-4a66-b1bb-0cc96f25d27d None None] MFA Rules not processed for user `2b28926500a14cd3aa74c59f60e076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:26.097287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6fe1c25f-1f9c-4a66-b1bb-0cc96f25d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:26.103879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1207/2455] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:26.116427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861bd18-35b2-41ab-9220-71653beff804 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:26.128422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861bd18-35b2-41ab-9220-71653beff804 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:26.132036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d1fe1-1380-4378-bef2-9707579ea659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:26.132670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1fe1-1380-4378-bef2-9707579ea659 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:26.132953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1fe1-1380-4378-bef2-9707579ea659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:26.133232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d1fe1-1380-4378-bef2-9707579ea659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:26.140574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d1fe1-1380-4378-bef2-9707579ea659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:26.142043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d1fe1-1380-4378-bef2-9707579ea659 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:26.150719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1249/2456] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:26.236395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe89c9-3fda-46ca-90e2-5c5942cb4c81 None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:26.236715 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe89c9-3fda-46ca-90e2-5c5942cb4c81 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:26.237045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe89c9-3fda-46ca-90e2-5c5942cb4c81 None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:26.238426 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1208/2457] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:13:26.243209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:26.243494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:26.243770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:26.262060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:26.263396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:26.273329 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1250/2458] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:26.285004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe89c9-3fda-46ca-90e2-5c5942cb4c81 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:26.296910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe89c9-3fda-46ca-90e2-5c5942cb4c81 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:26.300541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:26.301183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:26.301497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:26.301778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:26.312228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:26.313673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:26.324405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1209/2459] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:26.389663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:26.391103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:26.458880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dc0a4-0aa0-4644-9162-c34d44893433 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:26.463966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603824-c357-4b5c-a485-a175ace340b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:26.464608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603824-c357-4b5c-a485-a175ace340b4 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:26.464891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603824-c357-4b5c-a485-a175ace340b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:26.465164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603824-c357-4b5c-a485-a175ace340b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:26.467731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-31603824-c357-4b5c-a485-a175ace340b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:26.479066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31603824-c357-4b5c-a485-a175ace340b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:26.480632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31603824-c357-4b5c-a485-a175ace340b4 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:26.491377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1251/2460] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:28.049022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:28.058703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f19cd-4b17-490a-ae94-4b35006ef409 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:28.062686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:28.063338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:28.063623 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:28.063904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:28.065879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:28.076943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:28.078571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:28.094234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1210/2461] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:29.057535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187526dc-3223-4e60-864e-9941b756187e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:29.058036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187526dc-3223-4e60-864e-9941b756187e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:29.058143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187526dc-3223-4e60-864e-9941b756187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:29.076739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-187526dc-3223-4e60-864e-9941b756187e None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:29.077972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-187526dc-3223-4e60-864e-9941b756187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:29.085171 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1252/2462] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:29.098061 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:29.109993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111cebe-1a1f-4e4d-84e6-1bccf88d2360 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:29.114905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:29.115533 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:29.115811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:29.116083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:29.124050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:29.125639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:29.133536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1211/2463] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:13:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:13:31.289701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187526dc-3223-4e60-864e-9941b756187e None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:31.303245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187526dc-3223-4e60-864e-9941b756187e None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:31.309087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:31.309791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:31.310075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:31.310348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:31.312169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:31.372234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:31.373896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:31.385069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1253/2464] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:39.132186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=27 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:41.379234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:56.433156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:56.436427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:56.453626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce3166-ecfa-448e-bac4-afef7d751105 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:56.459973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e280d4a-4d69-4a4e-87c4-9dbb7fdf4432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:56.460630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280d4a-4d69-4a4e-87c4-9dbb7fdf4432 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:56.460910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280d4a-4d69-4a4e-87c4-9dbb7fdf4432 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:56.461187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280d4a-4d69-4a4e-87c4-9dbb7fdf4432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:56.463017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4e280d4a-4d69-4a4e-87c4-9dbb7fdf4432 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:56.476319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e280d4a-4d69-4a4e-87c4-9dbb7fdf4432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:56.477946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e280d4a-4d69-4a4e-87c4-9dbb7fdf4432 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:56.488870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1212/2465] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:58.117288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:58.128466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d6fe-8071-4dea-8d24-a038a67b956a service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:58.134132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:58.134819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:58.135109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:58.135384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:58.137181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:58.151003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:58.152615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:58.164779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1254/2466] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:14:00.391947 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e819-9565-4843-85f0-0a8c1a37c338 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:14:00.392437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e819-9565-4843-85f0-0a8c1a37c338 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:14:00.392517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e819-9565-4843-85f0-0a8c1a37c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:14:00.417087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a3f8e819-9565-4843-85f0-0a8c1a37c338 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:14:00.418338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a3f8e819-9565-4843-85f0-0a8c1a37c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:14:00.427046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1213/2467] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 14:14:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:14:00.441975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:14:00.453936 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf6d56-3f57-4d9c-ab8a-c7d45139c615 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:14:00.459069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e968a6-9a41-4595-9c37-4b5470c2fd5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:14:00.459722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e968a6-9a41-4595-9c37-4b5470c2fd5e service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:14:00.460004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e968a6-9a41-4595-9c37-4b5470c2fd5e service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:14:00.460278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e968a6-9a41-4595-9c37-4b5470c2fd5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:14:00.469525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e968a6-9a41-4595-9c37-4b5470c2fd5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:14:00.471112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e968a6-9a41-4595-9c37-4b5470c2fd5e service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:14:00.479461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1255/2468] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:14:02.594628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2a3d5-8097-4495-bc94-68e1418660ca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:14:02.595127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2a3d5-8097-4495-bc94-68e1418660ca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:14:02.595279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2a3d5-8097-4495-bc94-68e1418660ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:14:02.613410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7af2a3d5-8097-4495-bc94-68e1418660ca None None] MFA Rules not processed for user `887e53c1e74543ce914f94c0b2666fe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:14:02.614614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7af2a3d5-8097-4495-bc94-68e1418660ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:14:02.621730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1214/2469] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:14:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:14:10.476125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=12 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:12.607733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=12 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:17.475722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca991-d61a-41a3-8da3-caa29a37a4dd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:14:17.476250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca991-d61a-41a3-8da3-caa29a37a4dd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:14:17.476360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca991-d61a-41a3-8da3-caa29a37a4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:14:17.493925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-abdca991-d61a-41a3-8da3-caa29a37a4dd None None] MFA Rules not processed for user `ab8bc4faa499494f93571797e3c89e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:14:17.495124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-abdca991-d61a-41a3-8da3-caa29a37a4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:14:17.502268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1256/2470] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:14:17.808776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2a3d5-8097-4495-bc94-68e1418660ca None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:14:17.818816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2a3d5-8097-4495-bc94-68e1418660ca None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:14:17.822321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:14:17.822954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:14:17.823234 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:14:17.823505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:14:17.825254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:14:17.835356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:14:17.836758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:14:17.844725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1215/2471] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:14:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:14:27.488595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:27.841049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:14:33.203110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdca991-d61a-41a3-8da3-caa29a37a4dd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:14:33.216583 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdca991-d61a-41a3-8da3-caa29a37a4dd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:14:33.223592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba15867-c405-406b-ae96-629aab83a903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:14:33.224250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba15867-c405-406b-ae96-629aab83a903 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:14:33.224529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba15867-c405-406b-ae96-629aab83a903 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:14:33.224805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba15867-c405-406b-ae96-629aab83a903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:14:33.226676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bba15867-c405-406b-ae96-629aab83a903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:14:33.239846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba15867-c405-406b-ae96-629aab83a903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:14:33.241524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba15867-c405-406b-ae96-629aab83a903 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:14:33.252334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1257/2472] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:14:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:14:43.247572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:21.758569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:21.771761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f3b5-7e05-494f-b119-76abdc288ca3 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:21.777951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ab5c5-62f1-4ad0-8304-0e2834f66c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:21.778598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab5c5-62f1-4ad0-8304-0e2834f66c3c service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:21.778882 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab5c5-62f1-4ad0-8304-0e2834f66c3c service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:21.779160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ab5c5-62f1-4ad0-8304-0e2834f66c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:21.780934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8c2ab5c5-62f1-4ad0-8304-0e2834f66c3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:21.839996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab5c5-62f1-4ad0-8304-0e2834f66c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:21.841736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ab5c5-62f1-4ad0-8304-0e2834f66c3c service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:21.850718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1216/2473] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:31.850472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=28 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:32.337573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d924fea-3a86-475c-8fd2-f9836a8bb02e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:32.338093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d924fea-3a86-475c-8fd2-f9836a8bb02e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:32.338258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d924fea-3a86-475c-8fd2-f9836a8bb02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:32.356279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7d924fea-3a86-475c-8fd2-f9836a8bb02e None None] MFA Rules not processed for user `7d9d976d8d324b53bcc2adc4c6d081e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:32.357531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7d924fea-3a86-475c-8fd2-f9836a8bb02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:32.364380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1258/2474] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:33.306050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c4b-0799-4c12-879c-8fd142e0255b None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.306496 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c4b-0799-4c12-879c-8fd142e0255b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.306601 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c4b-0799-4c12-879c-8fd142e0255b None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.308878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1217/2475] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:33.315799 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49edfb-1b61-41fb-a21c-91894d02ce78 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.316370 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49edfb-1b61-41fb-a21c-91894d02ce78 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.316740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49edfb-1b61-41fb-a21c-91894d02ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.340150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-db49edfb-1b61-41fb-a21c-91894d02ce78 None None] MFA Rules not processed for user `2b28926500a14cd3aa74c59f60e076c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:33.342033 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-db49edfb-1b61-41fb-a21c-91894d02ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:33.349322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1259/2476] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:33.363837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06c4b-0799-4c12-879c-8fd142e0255b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:33.375390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06c4b-0799-4c12-879c-8fd142e0255b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:33.379592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55dc6e-fda6-4462-85c6-947c49dc2e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:33.380472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55dc6e-fda6-4462-85c6-947c49dc2e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.380757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55dc6e-fda6-4462-85c6-947c49dc2e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.381040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55dc6e-fda6-4462-85c6-947c49dc2e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.388964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55dc6e-fda6-4462-85c6-947c49dc2e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:33.390472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55dc6e-fda6-4462-85c6-947c49dc2e16 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:33.398395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1218/2477] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:33.485330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ba69-a7e7-40b5-92dd-9dddf95df017 None None] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.485669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ba69-a7e7-40b5-92dd-9dddf95df017 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.485958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27ba69-a7e7-40b5-92dd-9dddf95df017 None None] PATH_INFO: `/` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.487515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1260/2478] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:33.493581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7742-8112-4217-ab24-52fe822cb333 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.494210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7742-8112-4217-ab24-52fe822cb333 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.495179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7742-8112-4217-ab24-52fe822cb333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.518579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-db8c7742-8112-4217-ab24-52fe822cb333 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:33.519998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-db8c7742-8112-4217-ab24-52fe822cb333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:33.529789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1219/2479] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:33.542638 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ba69-a7e7-40b5-92dd-9dddf95df017 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:33.555686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27ba69-a7e7-40b5-92dd-9dddf95df017 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:33.560159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:33.560872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.561175 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.561476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.573554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:33.575155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:33.587057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1261/2480] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:43.511004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=9 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:43.582075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=12 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:07.240390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c7742-8112-4217-ab24-52fe822cb333 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:07.282014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c7742-8112-4217-ab24-52fe822cb333 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:07.285674 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:07.286321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:07.286607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:07.286888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:07.288675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:07.403840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:07.405200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:07.425243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1220/2481] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:10.688224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:10.742503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858da10b-08f6-4ec3-8662-19327c684786 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:10.748985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:10.749859 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:10.750151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:10.750430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:10.752346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:10.753622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:10.755677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:10.771913 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0ce86-b483-4226-b8bb-a73bff0a1c9c service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:10.777236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:10.778159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:10.778581 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:10.778870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] PATH_INFO: `/v3/users/887e53c1e74543ce914f94c0b2666fe4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:10.780075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] RBAC: Authorizing `identity:delete_user(user_id=887e53c1e74543ce914f94c0b2666fe4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:10.782150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:10.785717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:10.787326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:10.798470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1262/2482] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:10.831972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887e53c1e74543ce914f94c0b2666fe4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:10.839398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887e53c1e74543ce914f94c0b2666fe4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:10.840080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887e53c1e74543ce914f94c0b2666fe4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:10.840758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887e53c1e74543ce914f94c0b2666fe4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:10.847681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-82a736cc-da81-428a-bbda-f26ea81f086b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887e53c1e74543ce914f94c0b2666fe4'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:10.849886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:10.868432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1221/2483] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:10 2022] DELETE /identity/v3/users/887e53c1e74543ce914f94c0b2666fe4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:11.054314 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.067070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda11260-94a3-4e3a-84fa-a65ee955d923 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.148366 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.149224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.149542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.149812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] PATH_INFO: `/v3/projects/247dc0c1f278403e9188fafe45202e32` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.151557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247dc0c1f278403e9188fafe45202e32)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.153473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.204800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247dc0c1f278403e9188fafe45202e32', 'request_id': 'req-0474ea17-057d-4095-9d2f-90100a183047'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:11.217955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247dc0c1f278403e9188fafe45202e32', 'request_id': 'req-0474ea17-057d-4095-9d2f-90100a183047'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:11.227334 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247dc0c1f278403e9188fafe45202e32', 'request_id': 'req-0474ea17-057d-4095-9d2f-90100a183047'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:11.240610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] The token cache is being invalidate because project 247dc0c1f278403e9188fafe45202e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:11.240894 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:11.241627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-0474ea17-057d-4095-9d2f-90100a183047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:11.243180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1263/2484] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:11 2022] DELETE /identity/v3/projects/247dc0c1f278403e9188fafe45202e32 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:11.249237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ff495-b27d-4f95-a5fa-ba3c21ad3659 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.249559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ff495-b27d-4f95-a5fa-ba3c21ad3659 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.249836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ff495-b27d-4f95-a5fa-ba3c21ad3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.308005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-290ff495-b27d-4f95-a5fa-ba3c21ad3659 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:11.309184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-290ff495-b27d-4f95-a5fa-ba3c21ad3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:11.367968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1222/2485] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:11.376986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac53f16-7b09-40d5-92b5-56bcdfa5c211 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.377275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac53f16-7b09-40d5-92b5-56bcdfa5c211 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.377604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac53f16-7b09-40d5-92b5-56bcdfa5c211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.399979 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cac53f16-7b09-40d5-92b5-56bcdfa5c211 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:11.402531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cac53f16-7b09-40d5-92b5-56bcdfa5c211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:11.410585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1264/2486] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:11.415170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ff495-b27d-4f95-a5fa-ba3c21ad3659 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.426627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ff495-b27d-4f95-a5fa-ba3c21ad3659 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.431406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.432093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.432399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.432678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.433440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:16:11.433757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.435403 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.447832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1223/2487] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:16:11.452168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac53f16-7b09-40d5-92b5-56bcdfa5c211 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.461285 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac53f16-7b09-40d5-92b5-56bcdfa5c211 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.466770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.467410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.467688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.467957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.468641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.470548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.489764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:11.499536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1265/2488] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:11 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:11.503611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.514477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497f165-9b20-4463-a0e2-6ce7e811ff71 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.571671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.573080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.573387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.573667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.574354 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.576310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.595999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1224/2489] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:11 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:11.600243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.610923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a294ee-cabf-45b1-8311-a3e836e3ff60 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.615491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.616140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.616418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.616688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.617453 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.619057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.629881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1266/2490] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:11.634011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.644701 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6bf7f-9f13-42c9-9ff5-2cdbf9e12d60 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.649371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93474e51-74c4-4642-b16f-2ec7d6b113c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.650284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474e51-74c4-4642-b16f-2ec7d6b113c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.650469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474e51-74c4-4642-b16f-2ec7d6b113c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.650747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474e51-74c4-4642-b16f-2ec7d6b113c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.651359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93474e51-74c4-4642-b16f-2ec7d6b113c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.652962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93474e51-74c4-4642-b16f-2ec7d6b113c5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.663012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1225/2491] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:11.667648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.677684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a9cbb-0564-4d23-85cb-ddda2045e9a7 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.683077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.683939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.684213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.684502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] PATH_INFO: `/v3/projects/be029cb149c3460b84617c4411dd7f96/users/edf766aed31b4158aa5d4830642670b3/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.699304 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be029cb149c3460b84617c4411dd7f96, user_id=edf766aed31b4158aa5d4830642670b3, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.701970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.714774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1267/2492] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:11 2022] PUT /identity/v3/projects/be029cb149c3460b84617c4411dd7f96/users/edf766aed31b4158aa5d4830642670b3/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:11.725044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73764fb-c78e-4b9a-bf27-b6b389465a08 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.725332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73764fb-c78e-4b9a-bf27-b6b389465a08 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.725655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73764fb-c78e-4b9a-bf27-b6b389465a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.756608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-b73764fb-c78e-4b9a-bf27-b6b389465a08 None None] MFA Rules not processed for user `edf766aed31b4158aa5d4830642670b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:11.758165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b73764fb-c78e-4b9a-bf27-b6b389465a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:11.765434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:11.832384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1226/2493] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:11.836792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.898609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b042fe1-24f4-4774-acba-74b1fe3c4510 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:11.903791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:11.904374 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:11.904652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:11.904924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:11.905646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:11.907572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:11.933031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1268/2494] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:11 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:11.937124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73764fb-c78e-4b9a-bf27-b6b389465a08 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:11.948308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73764fb-c78e-4b9a-bf27-b6b389465a08 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:12.004274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:12.005044 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.005211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.005521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.006204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:12.008121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:12.030879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1227/2495] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:11 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:12.032085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:12.043319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c6753-eca0-48d6-b209-93fe5abc4c83 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:12.048203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:12.048854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.049138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.049443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.050166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:12.051753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:12.062194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1269/2496] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:12.066300 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:12.076868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d64b5-31c1-4bac-9f37-6a681d337d2a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:12.081497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:12.082380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.082655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.082925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] PATH_INFO: `/v3/projects/44e10c1c97e9439e94c854a6234ba466/users/f390765be3da4b76b564376913a440eb/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.098788 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e10c1c97e9439e94c854a6234ba466, user_id=f390765be3da4b76b564376913a440eb, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:12.101586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:12.115251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1228/2497] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:12 2022] PUT /identity/v3/projects/44e10c1c97e9439e94c854a6234ba466/users/f390765be3da4b76b564376913a440eb/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:12.120871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:12.131084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f89e6-fcb0-4039-ad83-5a0bd441193d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:12.189363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdd1ad-cc4e-4f72-9e58-638d56cf0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:12.189968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdd1ad-cc4e-4f72-9e58-638d56cf0962 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.190276 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdd1ad-cc4e-4f72-9e58-638d56cf0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.190553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdd1ad-cc4e-4f72-9e58-638d56cf0962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.191290 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdd1ad-cc4e-4f72-9e58-638d56cf0962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:12.192887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdd1ad-cc4e-4f72-9e58-638d56cf0962 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:12.205963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1270/2498] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:16:12.210197 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:12.221236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fd476-a368-400b-bc88-9010615e6092 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:12.225987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:12.226871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.227154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.227429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] PATH_INFO: `/v3/projects/44e10c1c97e9439e94c854a6234ba466/users/f390765be3da4b76b564376913a440eb/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.229634 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e10c1c97e9439e94c854a6234ba466, user_id=f390765be3da4b76b564376913a440eb, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:12.232270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:12.242729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1229/2499] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:12 2022] PUT /identity/v3/projects/44e10c1c97e9439e94c854a6234ba466/users/f390765be3da4b76b564376913a440eb/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:12.253042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.253331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.253643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.280544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] MFA Rules not processed for user `f390765be3da4b76b564376913a440eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:12.281792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:12.301896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:12.351145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1271/2500] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:12.362135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:12.363892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:12.433373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:12.448809 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33308-1e2e-4d6a-b54c-733127fe3d47 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:12.452619 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:12.453270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.453617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.453894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.463616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:12.465047 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:12.474378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1230/2501] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:12.521274 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:12.522700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:12.534584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c856566-6a4f-4155-8e1b-63729a8b2770 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:12.538206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7f7b3-0502-484d-8fed-6fda800a5a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:12.538839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7f7b3-0502-484d-8fed-6fda800a5a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:12.539119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7f7b3-0502-484d-8fed-6fda800a5a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:12.539395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7f7b3-0502-484d-8fed-6fda800a5a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:12.597589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7f7b3-0502-484d-8fed-6fda800a5a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:12.599017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7f7b3-0502-484d-8fed-6fda800a5a3e service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:12.607972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1272/2502] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:15.845222 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:15.907025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea46b6f-c677-498b-8fef-54a99053e1d7 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:15.911532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:15.912397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:15.912688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:15.912946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] PATH_INFO: `/v3/users/edf766aed31b4158aa5d4830642670b3` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:15.914284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf766aed31b4158aa5d4830642670b3)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:15.916993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:15.962538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf766aed31b4158aa5d4830642670b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:15.969274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf766aed31b4158aa5d4830642670b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:15.969903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf766aed31b4158aa5d4830642670b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:15.970491 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf766aed31b4158aa5d4830642670b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:15.977505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf766aed31b4158aa5d4830642670b3'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:15.996177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1231/2503] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:15 2022] DELETE /identity/v3/users/edf766aed31b4158aa5d4830642670b3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:16.000843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:16.001323 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:16.001489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:16.018900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:16.020095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:16.078874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1273/2504] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:16:16.088979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:16.090559 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:16.160099 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4302-01de-470d-a4e4-83c64559ac9e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:16.165415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:16.166747 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:16.167040 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:16.167313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:16.173708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:16.178332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:16.180593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:16.192201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1232/2505] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:16.460962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:16.463006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:16.475140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208c4bf-484d-4925-bb70-bbc3feb96c56 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:16.480746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:16.481831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:16.482109 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:16.482378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] PATH_INFO: `/v3/projects/be029cb149c3460b84617c4411dd7f96` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:16.484704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be029cb149c3460b84617c4411dd7f96)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:16.489441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:16.538269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be029cb149c3460b84617c4411dd7f96', 'request_id': 'req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.540106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:16.546087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be029cb149c3460b84617c4411dd7f96', 'request_id': 'req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.553475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be029cb149c3460b84617c4411dd7f96', 'request_id': 'req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.564978 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] The token cache is being invalidate because project be029cb149c3460b84617c4411dd7f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:16.565262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.565917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.567443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1274/2506] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:16 2022] DELETE /identity/v3/projects/be029cb149c3460b84617c4411dd7f96 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:16.571397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:16.581583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611b4b9-e416-4fbb-89b5-360b8b067497 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:16.639137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:16.640114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:16.640399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:16.640676 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] PATH_INFO: `/v3/users/f390765be3da4b76b564376913a440eb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:16.641877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f390765be3da4b76b564376913a440eb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:16.643799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:16.689943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f390765be3da4b76b564376913a440eb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.697567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f390765be3da4b76b564376913a440eb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.698191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f390765be3da4b76b564376913a440eb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.698792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f390765be3da4b76b564376913a440eb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.705646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-942d22d8-2eaa-456a-aaac-7947a4e4c301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f390765be3da4b76b564376913a440eb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:16.723510 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1233/2507] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:16 2022] DELETE /identity/v3/users/f390765be3da4b76b564376913a440eb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:16.992299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:16.995206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:17.008411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb52fe-c8ed-4bca-8474-f39d6c404d9e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.070572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.071394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.071684 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.072126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] PATH_INFO: `/v3/projects/44e10c1c97e9439e94c854a6234ba466` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.073449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e10c1c97e9439e94c854a6234ba466)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.075371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.121856 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e10c1c97e9439e94c854a6234ba466', 'request_id': 'req-f89296e4-8b93-4c2a-b551-c7f858a356d7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:17.127559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e10c1c97e9439e94c854a6234ba466', 'request_id': 'req-f89296e4-8b93-4c2a-b551-c7f858a356d7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:17.135035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e10c1c97e9439e94c854a6234ba466', 'request_id': 'req-f89296e4-8b93-4c2a-b551-c7f858a356d7'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:17.146089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] The token cache is being invalidate because project 44e10c1c97e9439e94c854a6234ba466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:17.146376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:17.147001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-f89296e4-8b93-4c2a-b551-c7f858a356d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:17.148562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1275/2508] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:16 2022] DELETE /identity/v3/projects/44e10c1c97e9439e94c854a6234ba466 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:17.154168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b742-d298-4863-9262-827a3bb1cbc4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.154643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b742-d298-4863-9262-827a3bb1cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.154739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b742-d298-4863-9262-827a3bb1cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.172862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d8a0b742-d298-4863-9262-827a3bb1cbc4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:17.174080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d8a0b742-d298-4863-9262-827a3bb1cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:17.232888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1234/2509] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:17.242071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e271-722a-4f1c-b3d6-1fea51a03407 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.242365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e271-722a-4f1c-b3d6-1fea51a03407 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.242643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4e271-722a-4f1c-b3d6-1fea51a03407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.260847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f8c4e271-722a-4f1c-b3d6-1fea51a03407 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:17.262079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f8c4e271-722a-4f1c-b3d6-1fea51a03407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:17.269941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1276/2510] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:17.274225 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0b742-d298-4863-9262-827a3bb1cbc4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.284566 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0b742-d298-4863-9262-827a3bb1cbc4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.289158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.289857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.290141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.290420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.292255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:16:17.292573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.294211 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.303086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:17.306790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1235/2511] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:16:17.310930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e271-722a-4f1c-b3d6-1fea51a03407 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.320297 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4e271-722a-4f1c-b3d6-1fea51a03407 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.325004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.325611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.325892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.326166 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.326853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.328731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.354709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1277/2512] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:17 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:17.358836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.369009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987df9b-6b92-467f-9b90-cdd68988865b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.425644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.426315 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.426599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.426877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.427567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.429532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.449625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1236/2513] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:17 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:17.453653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.464524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a978242-7a7c-486e-8542-38763853e64e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.469049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.469729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.470009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.470280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.471013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.472598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.482927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1278/2514] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:17.486979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.502647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f7622-c34e-4f1c-86ae-1de5ad9ef0b0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.511706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860614f-4b7e-43c9-9acc-d8620501c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.512537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860614f-4b7e-43c9-9acc-d8620501c3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.512828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860614f-4b7e-43c9-9acc-d8620501c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.513110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860614f-4b7e-43c9-9acc-d8620501c3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.513993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860614f-4b7e-43c9-9acc-d8620501c3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.515645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860614f-4b7e-43c9-9acc-d8620501c3b6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.527106 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1237/2515] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:17.531283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.541660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4dbaf-094e-4f93-a616-e6b43a8280b8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.546336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.547482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.547762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.548037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] PATH_INFO: `/v3/projects/03609579ebfb45499149d42ab17e027c/users/bab1ad0c57b6439382533df960a11da2/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.562857 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03609579ebfb45499149d42ab17e027c, user_id=bab1ad0c57b6439382533df960a11da2, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.565531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.579129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1279/2516] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:17 2022] PUT /identity/v3/projects/03609579ebfb45499149d42ab17e027c/users/bab1ad0c57b6439382533df960a11da2/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:17.590199 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735329f6-c452-46ac-929e-ef949aa88367 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.590489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735329f6-c452-46ac-929e-ef949aa88367 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.590771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735329f6-c452-46ac-929e-ef949aa88367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.617327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-735329f6-c452-46ac-929e-ef949aa88367 None None] MFA Rules not processed for user `bab1ad0c57b6439382533df960a11da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:17.618626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-735329f6-c452-46ac-929e-ef949aa88367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:17.683295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1238/2517] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:17.687694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.696371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:17.750676 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd186955-5441-476c-b24b-469f982196e9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.755346 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.755998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.756284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.756564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.757264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.759224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.784002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1280/2518] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:17 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:17.788064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735329f6-c452-46ac-929e-ef949aa88367 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.799860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735329f6-c452-46ac-929e-ef949aa88367 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.860673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.861332 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.861649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.861928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.862646 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.864604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.880012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:17.888087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1239/2519] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:17 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:17.892093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.903020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aba4e3-5c5a-4efb-928e-d56f129c0921 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.907628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.908281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.908564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.908839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.909598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.911239 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.922918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1281/2520] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:17.926779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.938043 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b125e6b-1982-47c8-8035-37ec0dec600b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.942848 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf28f57-7f0b-4858-a217-e838256b7c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.943579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28f57-7f0b-4858-a217-e838256b7c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.943782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28f57-7f0b-4858-a217-e838256b7c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.944059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf28f57-7f0b-4858-a217-e838256b7c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.944777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf28f57-7f0b-4858-a217-e838256b7c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.946406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf28f57-7f0b-4858-a217-e838256b7c53 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:17.957212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1240/2521] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:17.961287 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:17.971454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd2287-794f-4a9d-a26d-f533ed39f0db admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:17.976035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:17.976911 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:17.977193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:17.977506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] PATH_INFO: `/v3/projects/ccf830d676fe41a3afea9580ed89450f/users/bcdf082672c14ca5bbc4158dbf19315c/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:17.992464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf830d676fe41a3afea9580ed89450f, user_id=bcdf082672c14ca5bbc4158dbf19315c, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:17.995872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.010308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1282/2522] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:17 2022] PUT /identity/v3/projects/ccf830d676fe41a3afea9580ed89450f/users/bcdf082672c14ca5bbc4158dbf19315c/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:18.021543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518ec16-deab-4c8b-ba71-b230c17a46c6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.021834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518ec16-deab-4c8b-ba71-b230c17a46c6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.022112 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518ec16-deab-4c8b-ba71-b230c17a46c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.048993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2518ec16-deab-4c8b-ba71-b230c17a46c6 None None] MFA Rules not processed for user `bcdf082672c14ca5bbc4158dbf19315c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:18.050246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2518ec16-deab-4c8b-ba71-b230c17a46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:18.117732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1241/2523] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:18.122781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.186997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172f79-e090-4f6d-8769-9bc7659dc74b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.191755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.192417 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.192699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.192974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.193694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.195603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.221159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1283/2524] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:18 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:18.225217 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518ec16-deab-4c8b-ba71-b230c17a46c6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.236762 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518ec16-deab-4c8b-ba71-b230c17a46c6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.294307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.294986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.295267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.295544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.296273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.298518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.318046 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1242/2525] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:18 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:18.322038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.332361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb7e92-7bf9-4360-b566-de8e422df162 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.336972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.337852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.338144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.338421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.339148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.340739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.351225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1284/2526] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:18.356318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.366285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecae81-a539-4754-99e6-343d1e8a1695 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.371519 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.372327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.372605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.372876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] PATH_INFO: `/v3/projects/d6e3718d133e460ab7ce7219220befd5/users/5efb38913cae43c4b203898414ac0545/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.387337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e3718d133e460ab7ce7219220befd5, user_id=5efb38913cae43c4b203898414ac0545, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.390008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.403031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1243/2527] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:18 2022] PUT /identity/v3/projects/d6e3718d133e460ab7ce7219220befd5/users/5efb38913cae43c4b203898414ac0545/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:18.406945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.417775 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582b910-d253-4d07-bb7d-c31f221a523d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.446813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:18.474840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e206b-065d-4f11-a9b9-327b87a02cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.475504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e206b-065d-4f11-a9b9-327b87a02cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.475789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e206b-065d-4f11-a9b9-327b87a02cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.476069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e206b-065d-4f11-a9b9-327b87a02cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.476791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e206b-065d-4f11-a9b9-327b87a02cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.479236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e206b-065d-4f11-a9b9-327b87a02cb1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.488795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1285/2528] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:18.492929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.503767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52693c13-1d69-43ea-bd90-c6c5ed0d7012 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.508419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.509456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.509741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.510017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] PATH_INFO: `/v3/projects/d6e3718d133e460ab7ce7219220befd5/users/5efb38913cae43c4b203898414ac0545/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.512014 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e3718d133e460ab7ce7219220befd5, user_id=5efb38913cae43c4b203898414ac0545, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.514706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.525537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1244/2529] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:18 2022] PUT /identity/v3/projects/d6e3718d133e460ab7ce7219220befd5/users/5efb38913cae43c4b203898414ac0545/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:18.535759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601fc4a-9691-4574-ac84-14a3b170b040 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.536048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601fc4a-9691-4574-ac84-14a3b170b040 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.536351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601fc4a-9691-4574-ac84-14a3b170b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.563231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1601fc4a-9691-4574-ac84-14a3b170b040 None None] MFA Rules not processed for user `5efb38913cae43c4b203898414ac0545`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:18.564441 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1601fc4a-9691-4574-ac84-14a3b170b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:18.638361 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1286/2530] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:18.647700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.649549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:18.686598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:18.717928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3fbc7-5a3d-4eb1-b7ca-4afb66abe3db admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.721728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.722465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.722754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.723032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.733154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.734618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.744775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1245/2531] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:16:18.783259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601fc4a-9691-4574-ac84-14a3b170b040 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:18.793996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601fc4a-9691-4574-ac84-14a3b170b040 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:18.798739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7ceed-3e09-48a4-bb27-192fd01e14a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:18.799614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7ceed-3e09-48a4-bb27-192fd01e14a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:18.799996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7ceed-3e09-48a4-bb27-192fd01e14a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:18.800322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7ceed-3e09-48a4-bb27-192fd01e14a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:18.863699 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7ceed-3e09-48a4-bb27-192fd01e14a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:18.865259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7ceed-3e09-48a4-bb27-192fd01e14a7 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:18.876616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1287/2532] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:22.778678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:22.842878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f5d1d-739c-4805-a555-aedc58f56358 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:22.847503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:22.848369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:22.848648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:22.848972 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] PATH_INFO: `/v3/users/bab1ad0c57b6439382533df960a11da2` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:22.850144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab1ad0c57b6439382533df960a11da2)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:22.852139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:22.907408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab1ad0c57b6439382533df960a11da2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:22.918153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab1ad0c57b6439382533df960a11da2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:22.918804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab1ad0c57b6439382533df960a11da2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:22.919573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab1ad0c57b6439382533df960a11da2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:22.932655 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab1ad0c57b6439382533df960a11da2'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:22.955094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1246/2533] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:22 2022] DELETE /identity/v3/users/bab1ad0c57b6439382533df960a11da2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:22.959755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:22.960213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:22.960324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:22.978409 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:22.979621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:23.025301 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:23.041752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1288/2534] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:23.052656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:23.054066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:23.113608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bede26b-fa51-4baa-a8c2-f4bac6b439ac admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:23.117186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:23.117862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:23.118143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:23.118422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:23.125103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:23.130298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:23.132478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:23.143431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1247/2535] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:23.412418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:23.413865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:23.426931 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f063-09bd-40ad-bff4-2c433025908c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:23.431802 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:23.433694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:23.433989 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:23.434270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] PATH_INFO: `/v3/projects/03609579ebfb45499149d42ab17e027c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:23.435499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03609579ebfb45499149d42ab17e027c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:23.437482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:23.484926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03609579ebfb45499149d42ab17e027c', 'request_id': 'req-8bced187-f94c-4193-9e94-818fab1ea3e6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.490596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03609579ebfb45499149d42ab17e027c', 'request_id': 'req-8bced187-f94c-4193-9e94-818fab1ea3e6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.498620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03609579ebfb45499149d42ab17e027c', 'request_id': 'req-8bced187-f94c-4193-9e94-818fab1ea3e6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.510714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] The token cache is being invalidate because project 03609579ebfb45499149d42ab17e027c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:23.511020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.511667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.513246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1289/2536] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:23 2022] DELETE /identity/v3/projects/03609579ebfb45499149d42ab17e027c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:23.517207 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:23.527150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14866cf7-f45c-4a49-bf2d-6b841e920238 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:23.583740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:23.584605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:23.584909 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:23.585185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] PATH_INFO: `/v3/users/bcdf082672c14ca5bbc4158dbf19315c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:23.586382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcdf082672c14ca5bbc4158dbf19315c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:23.588316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:23.632887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcdf082672c14ca5bbc4158dbf19315c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.640671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcdf082672c14ca5bbc4158dbf19315c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.641291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcdf082672c14ca5bbc4158dbf19315c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.641948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcdf082672c14ca5bbc4158dbf19315c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.649000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcdf082672c14ca5bbc4158dbf19315c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:23.666944 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1248/2537] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:23 2022] DELETE /identity/v3/users/bcdf082672c14ca5bbc4158dbf19315c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:23.951443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:23.953523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:23.973496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bced187-f94c-4193-9e94-818fab1ea3e6 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:24.039215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:24.040065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:24.040345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:24.040618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] PATH_INFO: `/v3/projects/ccf830d676fe41a3afea9580ed89450f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:24.042632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf830d676fe41a3afea9580ed89450f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:24.044545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:24.091403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf830d676fe41a3afea9580ed89450f', 'request_id': 'req-26f6722c-eafb-4b76-9c4e-9720c631221c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.097476 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf830d676fe41a3afea9580ed89450f', 'request_id': 'req-26f6722c-eafb-4b76-9c4e-9720c631221c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.104848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf830d676fe41a3afea9580ed89450f', 'request_id': 'req-26f6722c-eafb-4b76-9c4e-9720c631221c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.115917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] The token cache is being invalidate because project ccf830d676fe41a3afea9580ed89450f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:24.116200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.116828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.118378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1290/2538] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:23 2022] DELETE /identity/v3/projects/ccf830d676fe41a3afea9580ed89450f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:24.122517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:24.123916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:24.138414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff0a2b-6f9a-4f8b-ad10-817f8d866c5d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:24.199039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:24.201878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:24.202156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:24.202437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] PATH_INFO: `/v3/users/5efb38913cae43c4b203898414ac0545` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:24.203615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efb38913cae43c4b203898414ac0545)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:24.205555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:24.219951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:24.264135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efb38913cae43c4b203898414ac0545'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.273430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efb38913cae43c4b203898414ac0545'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.274077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efb38913cae43c4b203898414ac0545'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.274808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efb38913cae43c4b203898414ac0545'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.282430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-538de85f-9580-41b7-8031-b73b6d3bfda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efb38913cae43c4b203898414ac0545'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.304366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1249/2539] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:24 2022] DELETE /identity/v3/users/5efb38913cae43c4b203898414ac0545 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:24.581011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:24.582614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:24.591981 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:24.603906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6722c-eafb-4b76-9c4e-9720c631221c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:24.661494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:24.662378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:24.662664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:24.662942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] PATH_INFO: `/v3/projects/d6e3718d133e460ab7ce7219220befd5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:24.664125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e3718d133e460ab7ce7219220befd5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:24.666083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:24.714205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e3718d133e460ab7ce7219220befd5', 'request_id': 'req-50e3646f-475e-4041-9898-3a8fd498aaf6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.719562 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e3718d133e460ab7ce7219220befd5', 'request_id': 'req-50e3646f-475e-4041-9898-3a8fd498aaf6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.726944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e3718d133e460ab7ce7219220befd5', 'request_id': 'req-50e3646f-475e-4041-9898-3a8fd498aaf6'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.738216 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] The token cache is being invalidate because project d6e3718d133e460ab7ce7219220befd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:24.738495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.739114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-50e3646f-475e-4041-9898-3a8fd498aaf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:24.740628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1291/2540] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:24 2022] DELETE /identity/v3/projects/d6e3718d133e460ab7ce7219220befd5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:24.747525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6610-e967-44eb-b74d-593d214f9b0a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:24.747814 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6610-e967-44eb-b74d-593d214f9b0a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:24.748092 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc6610-e967-44eb-b74d-593d214f9b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:24.767931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d2fc6610-e967-44eb-b74d-593d214f9b0a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:24.769108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d2fc6610-e967-44eb-b74d-593d214f9b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:24.830010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1250/2541] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:24.838915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c58993-3928-4e44-9e51-9282a2178361 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:24.839120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c58993-3928-4e44-9e51-9282a2178361 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:24.839421 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c58993-3928-4e44-9e51-9282a2178361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:24.858455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a6c58993-3928-4e44-9e51-9282a2178361 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:24.859681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a6c58993-3928-4e44-9e51-9282a2178361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:24.867649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1292/2542] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:24.872557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc6610-e967-44eb-b74d-593d214f9b0a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:24.882337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc6610-e967-44eb-b74d-593d214f9b0a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:24.886911 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:24.887551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:24.887829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:24.888101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:24.888853 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:16:24.889155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:24.890796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:24.902661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1251/2543] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:16:24.907194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c58993-3928-4e44-9e51-9282a2178361 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:24.917983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c58993-3928-4e44-9e51-9282a2178361 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:24.923185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:24.923858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:24.924203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:24.924400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:24.925073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:24.927001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:24.953200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1293/2544] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:24 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:24.957308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:24.967686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb838b6-e65f-4bb2-9950-e0ab9ab7b17c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.028765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.029462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.029744 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.030017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.031038 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.032939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.054789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1252/2545] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:24 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:16:25.059467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.070412 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b93ee-249e-4604-8217-4e796728a46b admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.075226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.076181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.076181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.076436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.077236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.078872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.090207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1294/2546] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:16:25.094078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.104840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b4fcc-fa60-4f3e-8610-f5ed3a3b918f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.109618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191d53-8777-4bfd-b524-328ca91e76e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.110280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191d53-8777-4bfd-b524-328ca91e76e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.110564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191d53-8777-4bfd-b524-328ca91e76e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.110841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191d53-8777-4bfd-b524-328ca91e76e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.111579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191d53-8777-4bfd-b524-328ca91e76e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.114417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191d53-8777-4bfd-b524-328ca91e76e4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.116663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:25.130766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1253/2547] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:25.131474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.142475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf0e0-1857-4060-8c97-2d7b22752448 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.147123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.148009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.148286 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.148564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] PATH_INFO: `/v3/projects/bb6554e40a7e42d9b636363d03cf84c5/users/38d0763dae104824979648aa92226687/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.163569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6554e40a7e42d9b636363d03cf84c5, user_id=38d0763dae104824979648aa92226687, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.166753 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.181610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1295/2548] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:25 2022] PUT /identity/v3/projects/bb6554e40a7e42d9b636363d03cf84c5/users/38d0763dae104824979648aa92226687/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:25.194827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8af7-db0d-448f-91a1-ab6270ecdb46 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.195120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8af7-db0d-448f-91a1-ab6270ecdb46 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.195401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8af7-db0d-448f-91a1-ab6270ecdb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.224223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0eaf8af7-db0d-448f-91a1-ab6270ecdb46 None None] MFA Rules not processed for user `38d0763dae104824979648aa92226687`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:25.225585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0eaf8af7-db0d-448f-91a1-ab6270ecdb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:25.296683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1254/2549] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:25.301517 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.335797 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:25.368011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8d6ff-4432-4c0a-80db-bffbca22bcfa admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.372707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.373451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.373735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.374007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.374702 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.376592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.403267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1296/2550] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:25 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:25.407420 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8af7-db0d-448f-91a1-ab6270ecdb46 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.419807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8af7-db0d-448f-91a1-ab6270ecdb46 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.475322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.475907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.476185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.476466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.477147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.479827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.499450 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1255/2551] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:25 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:16:25.503428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.514154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d230b2-acc5-4820-ac48-5e9b1f822094 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.518827 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.519482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.519764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.520039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.520762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.522384 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.533707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1297/2552] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:25.537843 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.549015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9f4d6-efa3-4c07-9fcb-efd007c2341a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.554388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.555557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.555837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.556111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] PATH_INFO: `/v3/projects/647238723c8e4617a9955a44d67e8a1d/users/d2861380a9d14dafacbe38758f8550ca/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.570888 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647238723c8e4617a9955a44d67e8a1d, user_id=d2861380a9d14dafacbe38758f8550ca, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.574241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.586929 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1256/2553] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:25 2022] PUT /identity/v3/projects/647238723c8e4617a9955a44d67e8a1d/users/d2861380a9d14dafacbe38758f8550ca/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:25.591495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.601627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399b47-f27e-4097-aa55-b023410a1cc2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.658764 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4136e-1320-4971-be53-9dc590830f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.659438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4136e-1320-4971-be53-9dc590830f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.659722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4136e-1320-4971-be53-9dc590830f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.659999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4136e-1320-4971-be53-9dc590830f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.660726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4136e-1320-4971-be53-9dc590830f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.662401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4136e-1320-4971-be53-9dc590830f90 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.673038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1298/2554] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:25.677177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.687306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81339150-0082-4e8e-bb1b-d1ab98bb3d39 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.691925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.692818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.693104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.693418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] PATH_INFO: `/v3/projects/647238723c8e4617a9955a44d67e8a1d/users/d2861380a9d14dafacbe38758f8550ca/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.695474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647238723c8e4617a9955a44d67e8a1d, user_id=d2861380a9d14dafacbe38758f8550ca, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.698859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.709132 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1257/2555] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:25 2022] PUT /identity/v3/projects/647238723c8e4617a9955a44d67e8a1d/users/d2861380a9d14dafacbe38758f8550ca/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:25.720145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2a58a-11f5-451d-ba55-1c7182a3bbf2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.720438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2a58a-11f5-451d-ba55-1c7182a3bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.720722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2a58a-11f5-451d-ba55-1c7182a3bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.747365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e4f2a58a-11f5-451d-ba55-1c7182a3bbf2 None None] MFA Rules not processed for user `d2861380a9d14dafacbe38758f8550ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:25.748508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e4f2a58a-11f5-451d-ba55-1c7182a3bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:25.815935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1299/2556] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:25.828438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:25.830121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:25.881421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:25.897000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dec76-a74c-45e2-9092-79ddbe8c7fa5 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:25.900723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:25.901951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:25.902257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:25.902535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:25.911530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:25.912956 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:25.923312 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1258/2557] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:26.003600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2a58a-11f5-451d-ba55-1c7182a3bbf2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:26.014398 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2a58a-11f5-451d-ba55-1c7182a3bbf2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:26.018103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:26.018748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:26.019031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:26.019308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:26.044653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:26.082693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:26.084125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:26.093672 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1300/2558] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:29.748262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:29.749789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:29.835760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9dae-9950-4c46-9cee-02843f9ccbc3 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:29.843589 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eab51e-9b01-4ae5-be2a-7c8f57a4a1e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:29.844368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab51e-9b01-4ae5-be2a-7c8f57a4a1e3 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:29.844716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab51e-9b01-4ae5-be2a-7c8f57a4a1e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:29.845074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab51e-9b01-4ae5-be2a-7c8f57a4a1e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:29.847802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-63eab51e-9b01-4ae5-be2a-7c8f57a4a1e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:29.866572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eab51e-9b01-4ae5-be2a-7c8f57a4a1e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:29.868171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eab51e-9b01-4ae5-be2a-7c8f57a4a1e3 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:29.879803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1259/2559] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:31.923782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:31.985228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d42f2-f43d-4d2f-b203-4c9eec731f13 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:31.989814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:31.990673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:31.990954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:31.991227 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] PATH_INFO: `/v3/users/38d0763dae104824979648aa92226687` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:31.992397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d0763dae104824979648aa92226687)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:31.994337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:32.046143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d0763dae104824979648aa92226687'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.053585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d0763dae104824979648aa92226687'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.054223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d0763dae104824979648aa92226687'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.066847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d0763dae104824979648aa92226687'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.067482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d0763dae104824979648aa92226687'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.080509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1301/2560] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:31 2022] DELETE /identity/v3/users/38d0763dae104824979648aa92226687 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:32.084981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:32.085499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:32.085599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:32.103749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:32.104987 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:32.163257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1260/2561] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:32.173498 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:32.174918 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:32.346711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:32.359439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04f34b-475d-44fd-a3bb-c2fd18f00dcd admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:32.363293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:32.363945 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:32.364226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:32.364500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:32.374072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:32.375526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:32.385261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1302/2562] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:32.819173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:32.820728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:32.834452 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972ef2e-17d3-4bfe-8705-794f47e3a364 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:32.840370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:32.846481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:32.846833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:32.847138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] PATH_INFO: `/v3/projects/bb6554e40a7e42d9b636363d03cf84c5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:32.848489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6554e40a7e42d9b636363d03cf84c5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:32.850461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:32.902979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6554e40a7e42d9b636363d03cf84c5', 'request_id': 'req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.910142 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6554e40a7e42d9b636363d03cf84c5', 'request_id': 'req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.917613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6554e40a7e42d9b636363d03cf84c5', 'request_id': 'req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.920000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:32.933448 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] The token cache is being invalidate because project bb6554e40a7e42d9b636363d03cf84c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:32.933772 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.934999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:32.936631 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1261/2563] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:32 2022] DELETE /identity/v3/projects/bb6554e40a7e42d9b636363d03cf84c5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:32.940531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:32.950990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723b16-b065-4691-9483-f8189d9643a4 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:33.009719 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:33.011156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.011565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.011975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] PATH_INFO: `/v3/users/d2861380a9d14dafacbe38758f8550ca` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.013041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2861380a9d14dafacbe38758f8550ca)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:33.014969 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:33.071512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2861380a9d14dafacbe38758f8550ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.085271 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2861380a9d14dafacbe38758f8550ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.086359 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2861380a9d14dafacbe38758f8550ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.100602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2861380a9d14dafacbe38758f8550ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.101317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56c9a5a6-3a06-49dd-b834-10cbd38340a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2861380a9d14dafacbe38758f8550ca'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.121124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1303/2564] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:32 2022] DELETE /identity/v3/users/d2861380a9d14dafacbe38758f8550ca => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:33.427562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:33.429179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:33.443886 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a87c-8f1a-4bbb-b3f1-c49d0a817453 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:33.517443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:33.518321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.518718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.519281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] PATH_INFO: `/v3/projects/647238723c8e4617a9955a44d67e8a1d` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.520304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] RBAC: Authorizing `identity:delete_project(project_id=647238723c8e4617a9955a44d67e8a1d)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:33.522308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:33.581749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647238723c8e4617a9955a44d67e8a1d', 'request_id': 'req-1d6afdfb-224c-4af3-9490-5b54703b825d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.590463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647238723c8e4617a9955a44d67e8a1d', 'request_id': 'req-1d6afdfb-224c-4af3-9490-5b54703b825d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.596677 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647238723c8e4617a9955a44d67e8a1d', 'request_id': 'req-1d6afdfb-224c-4af3-9490-5b54703b825d'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.608801 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] The token cache is being invalidate because project 647238723c8e4617a9955a44d67e8a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:33.609016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.609700 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1d6afdfb-224c-4af3-9490-5b54703b825d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:33.611399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1262/2565] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:33 2022] DELETE /identity/v3/projects/647238723c8e4617a9955a44d67e8a1d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:33.616891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d0ec-4fdf-416b-98e2-948b8625f231 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.617195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d0ec-4fdf-416b-98e2-948b8625f231 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.617494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5d0ec-4fdf-416b-98e2-948b8625f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.637467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-33c5d0ec-4fdf-416b-98e2-948b8625f231 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:33.638696 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-33c5d0ec-4fdf-416b-98e2-948b8625f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:33.699550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1304/2566] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:33.707721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334446-9180-4af3-b565-66901b5195da None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.708005 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334446-9180-4af3-b565-66901b5195da None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.708281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334446-9180-4af3-b565-66901b5195da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.727337 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-9d334446-9180-4af3-b565-66901b5195da None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:33.728629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9d334446-9180-4af3-b565-66901b5195da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:33.737069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1263/2567] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:33.741180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d0ec-4fdf-416b-98e2-948b8625f231 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:33.753443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5d0ec-4fdf-416b-98e2-948b8625f231 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:33.758154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:33.758814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.759307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.759596 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.760330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:16:33.761325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:33.762965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:33.764594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:33.778193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1305/2568] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:16:33.783369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334446-9180-4af3-b565-66901b5195da None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:33.794064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d334446-9180-4af3-b565-66901b5195da None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:33.799161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:33.799824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.800109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.800390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.801083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:33.803064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:33.832488 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1264/2569] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:33 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:16:33.833795 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:33.844997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ca499-4ccc-4656-b9bf-e0ba9aff2b9e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:33.904504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:33.905169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.905482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.905787 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.906478 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:33.908442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:33.930079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1306/2570] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:33 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:33.934554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:33.945321 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185cd3-245d-4de6-bf68-5992c2855b04 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:33.950999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:33.951778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.952130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.952478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.953319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:33.955102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:33.969819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1265/2571] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:33.971521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:33.982295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678e97-4bac-4bcb-92e3-fad6a6e4f089 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:33.987294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872556d-1832-4243-b3e4-acaf801da7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:33.988036 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872556d-1832-4243-b3e4-acaf801da7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:33.988408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872556d-1832-4243-b3e4-acaf801da7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:33.988790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872556d-1832-4243-b3e4-acaf801da7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:33.989590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872556d-1832-4243-b3e4-acaf801da7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:33.991266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872556d-1832-4243-b3e4-acaf801da7e0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:34.003049 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1307/2572] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:34.007424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:34.019081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b94963-4b39-4e01-9ecb-8d50512e195d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:34.023980 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:34.024970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.025400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.025750 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] PATH_INFO: `/v3/projects/6d4de5293a4c4b6ab3a9c5df9f22f1f5/users/1577b461d9634c28bdeae434ff7f227d/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.043301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4de5293a4c4b6ab3a9c5df9f22f1f5, user_id=1577b461d9634c28bdeae434ff7f227d, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:34.046008 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:34.061236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1266/2573] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:34 2022] PUT /identity/v3/projects/6d4de5293a4c4b6ab3a9c5df9f22f1f5/users/1577b461d9634c28bdeae434ff7f227d/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:34.072544 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9a75-a928-4ea2-abc0-b566d62bf4c3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.072973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9a75-a928-4ea2-abc0-b566d62bf4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.073324 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9a75-a928-4ea2-abc0-b566d62bf4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.100121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3dcf9a75-a928-4ea2-abc0-b566d62bf4c3 None None] MFA Rules not processed for user `1577b461d9634c28bdeae434ff7f227d`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:34.101425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3dcf9a75-a928-4ea2-abc0-b566d62bf4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:34.169039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1308/2574] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:34.180611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:34.182973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:34.210210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:34.248661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf3009-62c8-49af-b5ee-70a4ccddfdcb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:34.252324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbafbd-9053-46fc-ab94-5d57810b455c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:34.253124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbafbd-9053-46fc-ab94-5d57810b455c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.253374 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbafbd-9053-46fc-ab94-5d57810b455c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.253649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbafbd-9053-46fc-ab94-5d57810b455c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.267316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbafbd-9053-46fc-ab94-5d57810b455c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:34.268871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbafbd-9053-46fc-ab94-5d57810b455c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:34.279926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1267/2575] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:34.303962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9a75-a928-4ea2-abc0-b566d62bf4c3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:34.383665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b5086-6fdd-4e98-a179-42015e1675d7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.384150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b5086-6fdd-4e98-a179-42015e1675d7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.384553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9a75-a928-4ea2-abc0-b566d62bf4c3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:34.384828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b5086-6fdd-4e98-a179-42015e1675d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.390591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:34.391747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.392028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.392481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] PATH_INFO: `/v3/users/1577b461d9634c28bdeae434ff7f227d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.394430 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1577b461d9634c28bdeae434ff7f227d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:34.399515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:34.402616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:34.405934 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a70b5086-6fdd-4e98-a179-42015e1675d7 None None] MFA Rules not processed for user `ab8bc4faa499494f93571797e3c89e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:34.407398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a70b5086-6fdd-4e98-a179-42015e1675d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:34.452519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1577b461d9634c28bdeae434ff7f227d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:34.460717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1577b461d9634c28bdeae434ff7f227d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:34.461514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1577b461d9634c28bdeae434ff7f227d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:34.470179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1268/2576] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:34.474382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1577b461d9634c28bdeae434ff7f227d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:34.475322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1577b461d9634c28bdeae434ff7f227d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:34.487436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1309/2577] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:34 2022] DELETE /identity/v3/users/1577b461d9634c28bdeae434ff7f227d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:34.492328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.492618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.493011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.513743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:34.514868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:34.577691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1269/2578] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:34.587342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:34.589110 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:34.649561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8db8a-32b5-4491-a116-9fe3dc472027 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:34.653262 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f0b4-77bc-49e8-859a-a4b182faac26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:34.653927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f0b4-77bc-49e8-859a-a4b182faac26 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.654203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f0b4-77bc-49e8-859a-a4b182faac26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.654471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f0b4-77bc-49e8-859a-a4b182faac26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.664469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f0b4-77bc-49e8-859a-a4b182faac26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:34.665972 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f0b4-77bc-49e8-859a-a4b182faac26 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:34.676933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1310/2579] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:34.953498 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:34.955010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:34.971675 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89927e72-d3f9-49c6-abc6-ca49725758a0 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:34.976436 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:34.977535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:34.977824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:34.978104 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] PATH_INFO: `/v3/projects/6d4de5293a4c4b6ab3a9c5df9f22f1f5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:34.980310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4de5293a4c4b6ab3a9c5df9f22f1f5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:34.990016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.040034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4de5293a4c4b6ab3a9c5df9f22f1f5', 'request_id': 'req-b8d86761-bdda-4d7c-a647-de156c16eda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:35.048845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4de5293a4c4b6ab3a9c5df9f22f1f5', 'request_id': 'req-b8d86761-bdda-4d7c-a647-de156c16eda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:35.054578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4de5293a4c4b6ab3a9c5df9f22f1f5', 'request_id': 'req-b8d86761-bdda-4d7c-a647-de156c16eda5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:35.055706 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:35.069851 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] The token cache is being invalidate because project 6d4de5293a4c4b6ab3a9c5df9f22f1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:35.070608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:35.071735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b8d86761-bdda-4d7c-a647-de156c16eda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:35.077472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1270/2580] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:34 2022] DELETE /identity/v3/projects/6d4de5293a4c4b6ab3a9c5df9f22f1f5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:35.080270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404368f-2d28-4baa-8991-e50214dc346d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.080731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404368f-2d28-4baa-8991-e50214dc346d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.080831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404368f-2d28-4baa-8991-e50214dc346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.114103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-5404368f-2d28-4baa-8991-e50214dc346d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:35.115338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-5404368f-2d28-4baa-8991-e50214dc346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:35.187242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1311/2581] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:35.194868 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2c48-3cea-4779-9f90-d6e5796bf738 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.195432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2c48-3cea-4779-9f90-d6e5796bf738 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.195718 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b2c48-3cea-4779-9f90-d6e5796bf738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.215574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d70b2c48-3cea-4779-9f90-d6e5796bf738 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:35.216779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d70b2c48-3cea-4779-9f90-d6e5796bf738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:35.224979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1271/2582] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:35.229069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404368f-2d28-4baa-8991-e50214dc346d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:35.240007 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404368f-2d28-4baa-8991-e50214dc346d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:35.244602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:35.245539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.245817 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.246097 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.246825 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:16:35.247231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:35.248710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.260768 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1312/2583] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:16:35.265067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b2c48-3cea-4779-9f90-d6e5796bf738 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:35.284967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b2c48-3cea-4779-9f90-d6e5796bf738 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:35.291662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:35.292805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.293175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.293550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.294633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:35.297463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.329184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1272/2584] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:35 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:35.333267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:35.345040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e90da-d1ef-4494-9999-a52b53c7cf72 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:35.354362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:35.418044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:35.419093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.419921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.420310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.421559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:35.424424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.451118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1313/2585] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:35 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:16:35.456383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:35.472387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a4da9-512a-4cb5-a39d-07d92308b622 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:35.479239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:35.480469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.480727 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.481016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.481803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:35.483451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.495713 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1273/2586] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:35.500228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:35.511128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7235ffb-b979-4fa1-8274-ddc665294ba4 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:35.515881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da03be8-26f2-4d9b-ba0d-156657f1df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:35.516548 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da03be8-26f2-4d9b-ba0d-156657f1df38 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.516831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da03be8-26f2-4d9b-ba0d-156657f1df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.517114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da03be8-26f2-4d9b-ba0d-156657f1df38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.517882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da03be8-26f2-4d9b-ba0d-156657f1df38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:35.519580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da03be8-26f2-4d9b-ba0d-156657f1df38 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.531038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1314/2587] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:16:35.536889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:35.548326 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d4fae-0943-4144-901c-35e3926d46ce admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:35.553022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:35.554469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.554761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.555041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] PATH_INFO: `/v3/projects/7e1e6f1e6f8948e9adcb63690c65b6cb/users/da6f6643651e4065804bec881e93f5da/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.572527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1e6f1e6f8948e9adcb63690c65b6cb, user_id=da6f6643651e4065804bec881e93f5da, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:35.576298 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.594147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1274/2588] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:35 2022] PUT /identity/v3/projects/7e1e6f1e6f8948e9adcb63690c65b6cb/users/da6f6643651e4065804bec881e93f5da/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:35.606219 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8b79-0ef0-4521-ad40-b54131bd15c4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.606783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8b79-0ef0-4521-ad40-b54131bd15c4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.607078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a8b79-0ef0-4521-ad40-b54131bd15c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.641008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-089a8b79-0ef0-4521-ad40-b54131bd15c4 None None] MFA Rules not processed for user `da6f6643651e4065804bec881e93f5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:35.642397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-089a8b79-0ef0-4521-ad40-b54131bd15c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:35.710717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1315/2589] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:35.722935 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:35.724687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:35.788627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88996668-a781-49fe-bf44-4fdf571c1389 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:35.792665 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:35.793578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:35.794377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:35.794377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:35.810622 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:35.812176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:35.828063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1275/2590] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:16:45.707306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:45.819560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:49.666837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:49.669310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:49.670411 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:49.704713 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:49.706084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:49.749130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:49.777953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1316/2591] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:49.834905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362e67-2d99-461a-b1a6-d6e402744c9c service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:49.837173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:49.839328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:49.840254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:49.841268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:49.841684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:49.842231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] PATH_INFO: `/v3/users/da6f6643651e4065804bec881e93f5da` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:49.844078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6f6643651e4065804bec881e93f5da)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:49.846358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:49.906003 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6f6643651e4065804bec881e93f5da'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:49.919537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6f6643651e4065804bec881e93f5da'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:49.921685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6f6643651e4065804bec881e93f5da'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:49.922770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6f6643651e4065804bec881e93f5da'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:49.933174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0fb66838-ef30-4651-92ad-068d363250ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6f6643651e4065804bec881e93f5da'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:49.939623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1a53a-d827-43bc-8202-b28de1e3e6aa None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:49.945385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:49.946050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:49.946464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:49.946867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:49.948886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:49.960489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1276/2592] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:49 2022] DELETE /identity/v3/users/da6f6643651e4065804bec881e93f5da => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:49.963308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:49.965446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:49.965686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:49.965982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:49.966261 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:49.974647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1317/2593] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:16:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:16:49.984637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:49.986085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:50.093725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1277/2594] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:50.100347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:50.102001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:50.168044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b102a16-02ad-4b7f-a591-95718e2f3479 service swift] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:50.206093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:50.225944 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe5be2-d9a7-4249-8ff8-1f80a9947785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:50.226803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe5be2-d9a7-4249-8ff8-1f80a9947785 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:50.227164 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe5be2-d9a7-4249-8ff8-1f80a9947785 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:50.227514 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe5be2-d9a7-4249-8ff8-1f80a9947785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:50.238644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe5be2-d9a7-4249-8ff8-1f80a9947785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:50.240202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe5be2-d9a7-4249-8ff8-1f80a9947785 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:50.253801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1318/2595] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:50.567375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:50.569181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:50.586823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ad0b6-672f-4845-b06e-16e183f69fcc None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:50.592691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:50.594074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:50.594074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:50.594310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] PATH_INFO: `/v3/projects/7e1e6f1e6f8948e9adcb63690c65b6cb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:50.595787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1e6f1e6f8948e9adcb63690c65b6cb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:50.598500 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:50.622906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:50.676190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1e6f1e6f8948e9adcb63690c65b6cb', 'request_id': 'req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:50.685930 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1e6f1e6f8948e9adcb63690c65b6cb', 'request_id': 'req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:50.693883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1e6f1e6f8948e9adcb63690c65b6cb', 'request_id': 'req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:50.709064 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] The token cache is being invalidate because project 7e1e6f1e6f8948e9adcb63690c65b6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:50.709368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:50.710059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8b7b965e-acb8-48bf-a2c1-490d7bd24e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:50.711839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1278/2596] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:50 2022] DELETE /identity/v3/projects/7e1e6f1e6f8948e9adcb63690c65b6cb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:50.717874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3b491-984f-4c06-9c8a-f9444b94c342 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:50.718368 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3b491-984f-4c06-9c8a-f9444b94c342 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:50.718463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3b491-984f-4c06-9c8a-f9444b94c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:50.738890 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9bf3b491-984f-4c06-9c8a-f9444b94c342 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:50.740258 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9bf3b491-984f-4c06-9c8a-f9444b94c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:50.814095 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1319/2597] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:50.822163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8df7d-e9e3-473a-8e52-7447979e4262 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:50.823100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8df7d-e9e3-473a-8e52-7447979e4262 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:50.823386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8df7d-e9e3-473a-8e52-7447979e4262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:50.844188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8db8df7d-e9e3-473a-8e52-7447979e4262 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:50.845479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8db8df7d-e9e3-473a-8e52-7447979e4262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:50.858933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1279/2598] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:50.860245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3b491-984f-4c06-9c8a-f9444b94c342 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:50.870820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3b491-984f-4c06-9c8a-f9444b94c342 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:50.875486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:50.876145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:50.876427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:50.876701 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:50.877457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:16:50.877760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:50.879348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:50.893092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1320/2599] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:16:50.897233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8df7d-e9e3-473a-8e52-7447979e4262 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:50.907805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8df7d-e9e3-473a-8e52-7447979e4262 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:50.914119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:50.914852 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:50.915143 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:50.916071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:50.917012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:50.919903 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:50.950529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1280/2600] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:50 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:16:50.956422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:50.967358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f0c56-d1b9-40e7-b29d-6b8fefaef6ec admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:51.030027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:51.030901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:51.032876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:51.032876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:51.032876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:51.034730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:51.060413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1321/2601] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:50 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:51.064204 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:51.079032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb51f83-f2b5-4d30-b35f-f4abcc44df19 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:51.084817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:51.085740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:51.086029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:51.086440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:51.087970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:51.094347 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:51.115088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1281/2602] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:51.118971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:51.131982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519295cc-d33c-4c53-876e-3cf68487afc3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:51.140593 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5685472-4cea-40c3-8349-62419e00bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:51.141653 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5685472-4cea-40c3-8349-62419e00bd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:51.141773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5685472-4cea-40c3-8349-62419e00bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:51.141999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5685472-4cea-40c3-8349-62419e00bd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:51.143126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5685472-4cea-40c3-8349-62419e00bd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:51.144780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5685472-4cea-40c3-8349-62419e00bd87 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:51.157509 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1322/2603] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:51.161904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:51.175444 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21411b-2e32-4cf6-96d4-5399c1a101b3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:51.181025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:51.181943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:51.182327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:51.182617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] PATH_INFO: `/v3/projects/fae51a39308f41a2b4ff4ad90078e233/users/6ec4e241539a4415a8b43b41b22f142f/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:51.199878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae51a39308f41a2b4ff4ad90078e233, user_id=6ec4e241539a4415a8b43b41b22f142f, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:51.202650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:51.227791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1282/2604] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:51 2022] PUT /identity/v3/projects/fae51a39308f41a2b4ff4ad90078e233/users/6ec4e241539a4415a8b43b41b22f142f/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:51.229910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be9751-bf95-4ef8-ad36-08b04d8745dd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:51.230203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be9751-bf95-4ef8-ad36-08b04d8745dd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:51.230480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be9751-bf95-4ef8-ad36-08b04d8745dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:51.273493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-87be9751-bf95-4ef8-ad36-08b04d8745dd None None] MFA Rules not processed for user `6ec4e241539a4415a8b43b41b22f142f`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:51.274963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-87be9751-bf95-4ef8-ad36-08b04d8745dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:51.318758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:51.369841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1323/2605] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:51.380309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:51.382333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:51.476273 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52ae15-d820-405f-88ca-8c5c6c25a8d3 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:51.483640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a3572-2e60-4cd3-b42e-7a07d733dea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:51.484320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3572-2e60-4cd3-b42e-7a07d733dea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:51.484600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3572-2e60-4cd3-b42e-7a07d733dea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:51.484879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a3572-2e60-4cd3-b42e-7a07d733dea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:51.494725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a3572-2e60-4cd3-b42e-7a07d733dea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:51.496255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a3572-2e60-4cd3-b42e-7a07d733dea5 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:51.522435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1283/2606] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:54.237245 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be9751-bf95-4ef8-ad36-08b04d8745dd None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:54.308600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be9751-bf95-4ef8-ad36-08b04d8745dd None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:54.313005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:54.313882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:54.314156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:54.314424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] PATH_INFO: `/v3/users/6ec4e241539a4415a8b43b41b22f142f` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:54.315604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec4e241539a4415a8b43b41b22f142f)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:54.317550 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:54.366317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec4e241539a4415a8b43b41b22f142f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:54.374853 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec4e241539a4415a8b43b41b22f142f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:54.375554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec4e241539a4415a8b43b41b22f142f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:54.388561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec4e241539a4415a8b43b41b22f142f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:54.389221 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec4e241539a4415a8b43b41b22f142f'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:54.402722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1324/2607] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:54 2022] DELETE /identity/v3/users/6ec4e241539a4415a8b43b41b22f142f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:54.407449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:54.407924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:54.408024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:54.425932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:54.427205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:54.472499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:54.497140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1284/2608] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:16:54.507041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:54.508614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:54.567781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09924fb9-6acd-439a-bc2d-8b2ae4809757 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:54.571932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb57576-2b07-445f-92ee-d67195770e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:54.572752 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57576-2b07-445f-92ee-d67195770e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:54.573029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57576-2b07-445f-92ee-d67195770e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:54.573306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb57576-2b07-445f-92ee-d67195770e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:54.580708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:54.584035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb57576-2b07-445f-92ee-d67195770e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:54.586371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb57576-2b07-445f-92ee-d67195770e6a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:54.597659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1325/2609] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:55.065514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.067101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:55.080167 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3781d-1474-4c00-a3b3-13bf6edce29b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.086389 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.099262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.099635 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.100651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] PATH_INFO: `/v3/projects/fae51a39308f41a2b4ff4ad90078e233` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.103029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae51a39308f41a2b4ff4ad90078e233)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.106513 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.174466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae51a39308f41a2b4ff4ad90078e233', 'request_id': 'req-6e431f5e-95b1-4a44-8435-955a3dc8d607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:55.183865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae51a39308f41a2b4ff4ad90078e233', 'request_id': 'req-6e431f5e-95b1-4a44-8435-955a3dc8d607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:55.192010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae51a39308f41a2b4ff4ad90078e233', 'request_id': 'req-6e431f5e-95b1-4a44-8435-955a3dc8d607'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:55.206039 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] The token cache is being invalidate because project fae51a39308f41a2b4ff4ad90078e233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:55.206642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:55.206977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6e431f5e-95b1-4a44-8435-955a3dc8d607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:55.208844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1285/2610] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:55 2022] DELETE /identity/v3/projects/fae51a39308f41a2b4ff4ad90078e233 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:55.213506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb5a38-9871-41a4-b999-a74a374b46d7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.213793 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb5a38-9871-41a4-b999-a74a374b46d7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.214074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb5a38-9871-41a4-b999-a74a374b46d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.232663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b6fb5a38-9871-41a4-b999-a74a374b46d7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:55.233899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b6fb5a38-9871-41a4-b999-a74a374b46d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:55.311382 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc1eb5-0c88-4264-a4ca-366ebf089836 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.311485 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc1eb5-0c88-4264-a4ca-366ebf089836 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.312357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc1eb5-0c88-4264-a4ca-366ebf089836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.313418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1326/2611] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:55.330371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-83cc1eb5-0c88-4264-a4ca-366ebf089836 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:55.331661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-83cc1eb5-0c88-4264-a4ca-366ebf089836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:55.341390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1286/2612] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:16:55.344652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb5a38-9871-41a4-b999-a74a374b46d7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.354603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb5a38-9871-41a4-b999-a74a374b46d7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.359376 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.360064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.360335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.360613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.361328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:16:55.361663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.363243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.376620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1327/2613] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:16:55.381434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc1eb5-0c88-4264-a4ca-366ebf089836 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.391787 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc1eb5-0c88-4264-a4ca-366ebf089836 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.396821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.397516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.397804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.398081 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.398786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.400875 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.432341 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1287/2614] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:16:55 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:16:55.434229 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.452157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fac3cf-51cf-4924-b5f0-cd72827865cb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.525578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.526437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.526791 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.527143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.527926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.529985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.557385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1328/2615] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:16:55 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:16:55.561820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.583422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a7cea-d711-4ea4-9178-3e446a48e6a2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.589596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.590417 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.590709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.591415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.592020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.594094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.607442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1288/2616] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:16:55.611315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.623371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09deebc-1e75-428d-ae01-d6c70dfc42a5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.628190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a7bb0-74b0-4abb-8869-7c6b7e92d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.628868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7bb0-74b0-4abb-8869-7c6b7e92d1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.629156 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7bb0-74b0-4abb-8869-7c6b7e92d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.629466 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7bb0-74b0-4abb-8869-7c6b7e92d1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.630202 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a7bb0-74b0-4abb-8869-7c6b7e92d1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.631803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a7bb0-74b0-4abb-8869-7c6b7e92d1e2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.643561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1329/2617] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:16:55.647790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.658877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d568f1-b2e9-4e71-ba54-708d99689bdd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.664031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.665541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.665996 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.666208 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] PATH_INFO: `/v3/projects/f9c305703abc4d428334a8e35a875b9a/users/b134345a3cd14856b5efbbe284a6f6c2/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.683681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c305703abc4d428334a8e35a875b9a, user_id=b134345a3cd14856b5efbbe284a6f6c2, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.686606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.705025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1289/2618] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:16:55 2022] PUT /identity/v3/projects/f9c305703abc4d428334a8e35a875b9a/users/b134345a3cd14856b5efbbe284a6f6c2/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:16:55.707128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56d78-7d9c-4656-9cf9-5de4f8f0bd9c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.707128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56d78-7d9c-4656-9cf9-5de4f8f0bd9c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.707459 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b56d78-7d9c-4656-9cf9-5de4f8f0bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.728646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-30b56d78-7d9c-4656-9cf9-5de4f8f0bd9c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:55.730034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-30b56d78-7d9c-4656-9cf9-5de4f8f0bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:55.802536 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1330/2619] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:55.813812 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:55.815671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:55.882025 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293d07b-db53-420c-8c08-49e502db6332 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:55.885652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945209-c284-4604-b9a6-84fe08625dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:55.886327 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945209-c284-4604-b9a6-84fe08625dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:55.886607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945209-c284-4604-b9a6-84fe08625dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:55.886881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945209-c284-4604-b9a6-84fe08625dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:55.897671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945209-c284-4604-b9a6-84fe08625dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:55.899165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945209-c284-4604-b9a6-84fe08625dd6 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:55.911320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1290/2620] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:56.723636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b56d78-7d9c-4656-9cf9-5de4f8f0bd9c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:56.730835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:56.739844 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b56d78-7d9c-4656-9cf9-5de4f8f0bd9c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:56.751950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:56.753338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:56.754212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:56.754691 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:56.766527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:56.804785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:56.807549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:56.821214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1331/2621] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:56.882902 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:56.883407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:56.883951 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:56.893384 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:56.925029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] MFA Rules not processed for user `b134345a3cd14856b5efbbe284a6f6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:56.927201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:57.082740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1291/2622] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:57.102351 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:57.104296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:57.245093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff4b87-9d7c-4463-9117-6a0548820d0d service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:57.256385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:57.257381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:57.258354 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:57.259379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:57.275917 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:57.277389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:57.288139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1332/2623] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:57.831998 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:57.833594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:57.904591 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:57.907043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:57.923463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615fd4d-3a40-47a8-91f5-25196bc5c797 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:57.924447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2522a37-06f7-4081-b383-8ddcf484c025 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:57.928189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:57.929059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:57.929335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:57.929889 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] PATH_INFO: `/v3/users/f71924f4c69e40599c19aedbde756bcc` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:57.931118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:57.931770 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:57.931891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71924f4c69e40599c19aedbde756bcc)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:57.932057 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:57.932333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:57.933792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:57.934160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:57.947833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:57.949516 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:57.961451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1292/2624] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:16:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:57.984152 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71924f4c69e40599c19aedbde756bcc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:57.991674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71924f4c69e40599c19aedbde756bcc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:57.992383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71924f4c69e40599c19aedbde756bcc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.005173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71924f4c69e40599c19aedbde756bcc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.005854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71924f4c69e40599c19aedbde756bcc'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.018248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1333/2625] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:57 2022] DELETE /identity/v3/users/f71924f4c69e40599c19aedbde756bcc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:58.202536 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:58.215203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41153e4-479b-4a14-ab48-37792fc85ca3 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:58.272395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:58.273268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:58.273607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:58.273936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] PATH_INFO: `/v3/projects/5db59433c79e4006987a047747f60020` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:58.275497 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db59433c79e4006987a047747f60020)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:58.277435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:58.308595 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:58.326943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db59433c79e4006987a047747f60020', 'request_id': 'req-c94fa242-a74d-4252-813b-94238855c8af'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.333573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db59433c79e4006987a047747f60020', 'request_id': 'req-c94fa242-a74d-4252-813b-94238855c8af'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.340475 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db59433c79e4006987a047747f60020', 'request_id': 'req-c94fa242-a74d-4252-813b-94238855c8af'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.352982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] The token cache is being invalidate because project 5db59433c79e4006987a047747f60020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:58.353264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.353939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.355486 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1293/2626] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:58 2022] DELETE /identity/v3/projects/5db59433c79e4006987a047747f60020 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:58.359474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:58.360878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:58.374770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187369aa-7e45-4836-b64f-38630c080454 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:58.434037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:58.434901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:58.435179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:58.435449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] PATH_INFO: `/v3/users/9d25d8c43615403a84ecf530b2731060` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:58.436649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d25d8c43615403a84ecf530b2731060)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:58.438651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:58.443191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:58.486965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d25d8c43615403a84ecf530b2731060'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.495715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d25d8c43615403a84ecf530b2731060'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.496380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d25d8c43615403a84ecf530b2731060'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.508162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d25d8c43615403a84ecf530b2731060'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.509601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-08dbf87a-d379-4c3e-9a47-0d559c43ff2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d25d8c43615403a84ecf530b2731060'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.523342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1334/2627] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:16:58 2022] DELETE /identity/v3/users/9d25d8c43615403a84ecf530b2731060 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:16:58.716649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:16:58.717812 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1bcea-ae3e-4e9f-80a7-09aeb9eb52e9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:58.718244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:58.718425 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1bcea-ae3e-4e9f-80a7-09aeb9eb52e9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:58.718940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1bcea-ae3e-4e9f-80a7-09aeb9eb52e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:58.733709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fa242-a74d-4252-813b-94238855c8af admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:16:58.748289 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b4f1bcea-ae3e-4e9f-80a7-09aeb9eb52e9 None None] MFA Rules not processed for user `b134345a3cd14856b5efbbe284a6f6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:16:58.750689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b4f1bcea-ae3e-4e9f-80a7-09aeb9eb52e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:16:58.796891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:16:58.797879 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:16:58.798415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:16:58.798415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] PATH_INFO: `/v3/projects/bf9b35cc921346fa884869f9f20f72ab` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:16:58.799594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9b35cc921346fa884869f9f20f72ab)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:16:58.801543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:16:58.809464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1335/2628] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:16:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:16:58.853985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9b35cc921346fa884869f9f20f72ab', 'request_id': 'req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.862173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9b35cc921346fa884869f9f20f72ab', 'request_id': 'req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.869965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9b35cc921346fa884869f9f20f72ab', 'request_id': 'req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.881293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] The token cache is being invalidate because project bf9b35cc921346fa884869f9f20f72ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:16:58.881608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.882322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:16:58.884228 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1294/2629] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:16:58 2022] DELETE /identity/v3/projects/bf9b35cc921346fa884869f9f20f72ab => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:08.801652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:08.878056 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.925609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd353e6c-bf06-4ddb-bbc8-c59a86b802d4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.926406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd353e6c-bf06-4ddb-bbc8-c59a86b802d4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.926586 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd353e6c-bf06-4ddb-bbc8-c59a86b802d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.945002 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-fd353e6c-bf06-4ddb-bbc8-c59a86b802d4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:40.946880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-fd353e6c-bf06-4ddb-bbc8-c59a86b802d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:41.004020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1336/2630] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:41.032912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.034443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:41.144414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3b3e2-e4ab-421c-8824-d224f1f0dd7e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.148288 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.149017 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.149827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.150122 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.158625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.160226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.170139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1295/2631] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:44.945148 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7edfbf-d14c-49c7-b016-c7e2e8531196 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:44.945740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7edfbf-d14c-49c7-b016-c7e2e8531196 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:44.945740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7edfbf-d14c-49c7-b016-c7e2e8531196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:44.963410 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0c7edfbf-d14c-49c7-b016-c7e2e8531196 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:44.964616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0c7edfbf-d14c-49c7-b016-c7e2e8531196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:44.972538 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1337/2632] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:45.004161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:45.005839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:45.020359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e182774-6100-4b75-ab80-2ff6c1f464e0 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:45.026246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:45.026883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.027160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.027431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.035708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:45.037483 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:45.048471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1296/2633] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:49.239786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:49.240312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:49.240312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:49.257569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:49.259344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:49.267086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1338/2634] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:49.291608 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:49.303325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1187923-9038-4161-9b07-74e4b5b481b7 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:49.309106 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8ca4-ef84-40d1-a8cb-324390561ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:49.309792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8ca4-ef84-40d1-a8cb-324390561ec1 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:49.310079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8ca4-ef84-40d1-a8cb-324390561ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:49.310357 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8ca4-ef84-40d1-a8cb-324390561ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:49.318924 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8ca4-ef84-40d1-a8cb-324390561ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:49.320489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d8ca4-ef84-40d1-a8cb-324390561ec1 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:49.330771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1297/2635] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:52.323639 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:52.325174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:52.381555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cba04-05ef-4cbc-a85c-a51b8b01935b None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:52.385823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:52.386469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:52.386751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:52.387027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:52.388818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:52.403560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:52.404996 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:52.416717 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1339/2636] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:53.292001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec04de2-7d5d-4d20-9486-7e00d221431c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:53.292525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec04de2-7d5d-4d20-9486-7e00d221431c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:53.292652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec04de2-7d5d-4d20-9486-7e00d221431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:53.310191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6ec04de2-7d5d-4d20-9486-7e00d221431c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:53.311385 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6ec04de2-7d5d-4d20-9486-7e00d221431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:53.319166 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1298/2637] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:53.346542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:53.358464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5db8a-806b-42cc-85b1-3f3543efba4a service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:53.363994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1944fd-bf65-40e2-a819-c184498e156a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:53.364625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1944fd-bf65-40e2-a819-c184498e156a service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:53.364907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1944fd-bf65-40e2-a819-c184498e156a service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:53.365182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1944fd-bf65-40e2-a819-c184498e156a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:53.373571 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1944fd-bf65-40e2-a819-c184498e156a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:53.375143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1944fd-bf65-40e2-a819-c184498e156a service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:53.384443 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1340/2638] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:54.760596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec04de2-7d5d-4d20-9486-7e00d221431c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:54.770305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec04de2-7d5d-4d20-9486-7e00d221431c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:54.773938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:54.774583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:54.774950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:54.775282 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:54.778428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:54.793087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:54.794814 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:54.805915 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1299/2639] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:58.524891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fedf50-b910-4fb1-8f10-4483664fa211 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:58.525564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fedf50-b910-4fb1-8f10-4483664fa211 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:58.525564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fedf50-b910-4fb1-8f10-4483664fa211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.548724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-94fedf50-b910-4fb1-8f10-4483664fa211 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:58.553895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-94fedf50-b910-4fb1-8f10-4483664fa211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:58.562266 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1341/2640] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:58.592333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:58.604269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6129a22-f56b-485e-847a-dc884ed8a63e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:58.611213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:58.611884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:58.612172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:58.612454 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.621799 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:58.623578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:58.634937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1300/2641] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:03.737484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383fe5-62a5-463f-8ddf-1577e10a9fa6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.738046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383fe5-62a5-463f-8ddf-1577e10a9fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.738046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41383fe5-62a5-463f-8ddf-1577e10a9fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.757165 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-41383fe5-62a5-463f-8ddf-1577e10a9fa6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:03.758399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-41383fe5-62a5-463f-8ddf-1577e10a9fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:03.767070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1342/2642] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:03.792431 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.803999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc8e91-f918-4b68-9df8-de564460835a service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.810203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.810838 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.811119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.811395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.819502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.821051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.831102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1301/2643] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:04.193848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383fe5-62a5-463f-8ddf-1577e10a9fa6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:04.203731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41383fe5-62a5-463f-8ddf-1577e10a9fa6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:04.207426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:04.208064 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.208342 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.212022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.212022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:04.273205 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:04.274675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:04.283841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1343/2644] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:11.410558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:11.414931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=77 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:11.421140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127aa6f-08af-427f-99a4-36233c23f8f7 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:11.425100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:11.425783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:11.426072 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:11.426350 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:11.428165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:11.440593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:11.442078 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:11.452692 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1302/2645] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:14.279715 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:18.365707 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:18.367337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:18.382355 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4bddc-9f2e-42ae-9722-2449baad8337 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.387052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.387916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.388201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.389024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] PATH_INFO: `/v3/users/69e4f43bf52f41d8bded1f72b271cb4d` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.390333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e4f43bf52f41d8bded1f72b271cb4d)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.392246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:18.437666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e4f43bf52f41d8bded1f72b271cb4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.445096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e4f43bf52f41d8bded1f72b271cb4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.445748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e4f43bf52f41d8bded1f72b271cb4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.458528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e4f43bf52f41d8bded1f72b271cb4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.459211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e4f43bf52f41d8bded1f72b271cb4d'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.471424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1344/2646] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:18 2022] DELETE /identity/v3/users/69e4f43bf52f41d8bded1f72b271cb4d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:18.731264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:18.743502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38b7e-8d61-4a45-bc22-a840d9f1de8e service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.811119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.812045 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.812330 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.812604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] PATH_INFO: `/v3/projects/645eb1c9b52145aaa72e6a4b92d3996f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.813834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=645eb1c9b52145aaa72e6a4b92d3996f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.815733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:18.860780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645eb1c9b52145aaa72e6a4b92d3996f', 'request_id': 'req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.867562 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645eb1c9b52145aaa72e6a4b92d3996f', 'request_id': 'req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.874351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645eb1c9b52145aaa72e6a4b92d3996f', 'request_id': 'req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.885954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] The token cache is being invalidate because project 645eb1c9b52145aaa72e6a4b92d3996f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:18.886178 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.886814 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:18.888352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1303/2647] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:18 2022] DELETE /identity/v3/projects/645eb1c9b52145aaa72e6a4b92d3996f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:18.892418 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:18.893863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:18.907069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbca02-603d-4b3f-8fcd-46b213552b92 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.964565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.965473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.965759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.966039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] PATH_INFO: `/v3/users/497a3f4c07344f278d0a13a719e30290` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.967515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=497a3f4c07344f278d0a13a719e30290)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.969445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:19.015063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497a3f4c07344f278d0a13a719e30290'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.022123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497a3f4c07344f278d0a13a719e30290'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.022755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497a3f4c07344f278d0a13a719e30290'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.035220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497a3f4c07344f278d0a13a719e30290'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.035878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-65cef27c-daff-48e8-b850-05f88cc8d233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497a3f4c07344f278d0a13a719e30290'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.038041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:19.051911 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1345/2648] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:18 2022] DELETE /identity/v3/users/497a3f4c07344f278d0a13a719e30290 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:19.335586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:19.337203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:19.352235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c33f0-be55-45d3-a85a-80aa8cfbf45f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:19.425761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:19.426637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.426917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.427189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] PATH_INFO: `/v3/projects/cec9f551240b42bc9f610a1f2dc1e5eb` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.428366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec9f551240b42bc9f610a1f2dc1e5eb)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:19.430592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:19.456041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:19.485398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec9f551240b42bc9f610a1f2dc1e5eb', 'request_id': 'req-e37fd716-7caf-4fb9-a488-2915868bf2bd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.494899 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec9f551240b42bc9f610a1f2dc1e5eb', 'request_id': 'req-e37fd716-7caf-4fb9-a488-2915868bf2bd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.504468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec9f551240b42bc9f610a1f2dc1e5eb', 'request_id': 'req-e37fd716-7caf-4fb9-a488-2915868bf2bd'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.517175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] The token cache is being invalidate because project cec9f551240b42bc9f610a1f2dc1e5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:19.517535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.518195 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.519926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1304/2649] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:19 2022] DELETE /identity/v3/projects/cec9f551240b42bc9f610a1f2dc1e5eb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:19.669369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e876e-f3a5-45f4-9de8-461409d0c5bd None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.670521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e876e-f3a5-45f4-9de8-461409d0c5bd None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.670615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e876e-f3a5-45f4-9de8-461409d0c5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.729976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9a2e876e-f3a5-45f4-9de8-461409d0c5bd None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:19.729976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9a2e876e-f3a5-45f4-9de8-461409d0c5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:19.839240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1346/2650] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:19.883714 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:19.885148 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:19.976850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd716-7caf-4fb9-a488-2915868bf2bd admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:19.981862 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:19.983150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.983438 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.983720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.991864 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:19.993482 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:20.001643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1305/2651] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:18:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:18:24.624394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.626449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.626839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.652522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] MFA Rules not processed for user `b134345a3cd14856b5efbbe284a6f6c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:24.653863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.729524 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1347/2652] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:25.665176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:25.667535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.758766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899006-0a7f-47dc-b7e6-7e087ef48582 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.765587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4be79-aa5a-4eb9-92fa-6b8c0b5c11cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.766275 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4be79-aa5a-4eb9-92fa-6b8c0b5c11cb service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.766546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4be79-aa5a-4eb9-92fa-6b8c0b5c11cb service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.766828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4be79-aa5a-4eb9-92fa-6b8c0b5c11cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.768798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-16f4be79-aa5a-4eb9-92fa-6b8c0b5c11cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.784293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4be79-aa5a-4eb9-92fa-6b8c0b5c11cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.787024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4be79-aa5a-4eb9-92fa-6b8c0b5c11cb service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:25.801931 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1306/2653] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:27.886607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.889101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:27.971197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e983c-0e48-4034-b6a7-4383e5f55d0a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.978832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf29f62-bf1f-4172-9f3a-d7917c6c2371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.979542 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29f62-bf1f-4172-9f3a-d7917c6c2371 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.979995 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29f62-bf1f-4172-9f3a-d7917c6c2371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.982123 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf29f62-bf1f-4172-9f3a-d7917c6c2371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.985621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1bf29f62-bf1f-4172-9f3a-d7917c6c2371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:27.998068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf29f62-bf1f-4172-9f3a-d7917c6c2371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:28.000838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf29f62-bf1f-4172-9f3a-d7917c6c2371 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:28.009705 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1348/2654] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:35.794817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:37.741892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd358f7-b980-46b6-a18d-36fafe1867ce None None] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.742590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd358f7-b980-46b6-a18d-36fafe1867ce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.742590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd358f7-b980-46b6-a18d-36fafe1867ce None None] PATH_INFO: `/` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.743828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1307/2655] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 14:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:18:37.749641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775088-7648-4db1-b5cb-4a1b5a3c66e1 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.750105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775088-7648-4db1-b5cb-4a1b5a3c66e1 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.750423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1775088-7648-4db1-b5cb-4a1b5a3c66e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.771063 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:37.795673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e1775088-7648-4db1-b5cb-4a1b5a3c66e1 None None] MFA Rules not processed for user `85186f8437164bbbb99e007b5c85bd54`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:37.796813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e1775088-7648-4db1-b5cb-4a1b5a3c66e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.884061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1349/2656] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:37.899631 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd358f7-b980-46b6-a18d-36fafe1867ce None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.901802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7cd358f7-b980-46b6-a18d-36fafe1867ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.971121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd358f7-b980-46b6-a18d-36fafe1867ce None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.975034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.975783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.976192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.976489 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.989190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.990778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.002971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1308/2657] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:42.927174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2203-a1f2-4ab6-a10b-fae1018964bc None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.927757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2203-a1f2-4ab6-a10b-fae1018964bc None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.927757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe2203-a1f2-4ab6-a10b-fae1018964bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.950897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-07fe2203-a1f2-4ab6-a10b-fae1018964bc None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:42.952118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-07fe2203-a1f2-4ab6-a10b-fae1018964bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:42.960303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1350/2658] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:42.973378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.987691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50354aa-4744-4495-9abf-67f78346d25b service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.993290 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.993995 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.994278 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.994574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.004120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.005999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.015254 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1309/2659] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:18:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:18:43.709534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.709747 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.710005 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.730681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:43.732293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.800629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1351/2660] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:43.831235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.832776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.848731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b2cc1-9bda-4f42-a502-b87bcd512ef5 service swift] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.855704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc3df7-2736-49e9-87a6-5c983f686ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.856376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3df7-2736-49e9-87a6-5c983f686ddb service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.856661 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3df7-2736-49e9-87a6-5c983f686ddb service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.856939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc3df7-2736-49e9-87a6-5c983f686ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.865415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc3df7-2736-49e9-87a6-5c983f686ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.867004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc3df7-2736-49e9-87a6-5c983f686ddb service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.876923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1310/2661] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:44.785820 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.787307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.804283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a195e96-590c-4c55-8858-6fec489feca7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.810961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.811625 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.812000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.812381 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.814773 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.923331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.925936 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.939904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:44.953176 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1352/2662] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:53.872305 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=38 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:54.951356 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:04.428188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7cb0f-d084-40b0-839d-068ba9323897 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:04.428912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7cb0f-d084-40b0-839d-068ba9323897 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:04.430089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7cb0f-d084-40b0-839d-068ba9323897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:04.452900 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d1f7cb0f-d084-40b0-839d-068ba9323897 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:04.454187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d1f7cb0f-d084-40b0-839d-068ba9323897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:04.463550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1311/2663] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:04.491556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:04.503223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4e42-cbab-4fc2-940e-88992e94b0b7 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:04.510163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e52f07-5888-4336-8baf-f859567271fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:04.510735 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52f07-5888-4336-8baf-f859567271fe service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:04.511013 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52f07-5888-4336-8baf-f859567271fe service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:04.511282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e52f07-5888-4336-8baf-f859567271fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:04.521181 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e52f07-5888-4336-8baf-f859567271fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:04.523512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e52f07-5888-4336-8baf-f859567271fe service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:04.533819 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1353/2664] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:05.630810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7cb0f-d084-40b0-839d-068ba9323897 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.658642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7cb0f-d084-40b0-839d-068ba9323897 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.666410 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.667076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.667548 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.667834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.669755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.685490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.687274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.700755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1312/2665] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:09.523912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1422f2-dbc9-4f1c-be13-70247d00c02e None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:09.524440 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1422f2-dbc9-4f1c-be13-70247d00c02e None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:09.524541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1422f2-dbc9-4f1c-be13-70247d00c02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:09.542907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-0c1422f2-dbc9-4f1c-be13-70247d00c02e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:09.544136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-0c1422f2-dbc9-4f1c-be13-70247d00c02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:09.552045 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1354/2666] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:09.586699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:09.597783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335c6d-f07c-4984-ba12-10a34788864a service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:09.604113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:09.604752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:09.605034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:09.605307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:09.613537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:09.615192 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:09.626125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1313/2667] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:11.053904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85b199-842e-4a4a-a3ff-559b80944471 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:11.054621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85b199-842e-4a4a-a3ff-559b80944471 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:11.054621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85b199-842e-4a4a-a3ff-559b80944471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:11.072627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-ec85b199-842e-4a4a-a3ff-559b80944471 None None] MFA Rules not processed for user `00828d68497c433d80fa2155b21adff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:11.073833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-ec85b199-842e-4a4a-a3ff-559b80944471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:11.080975 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1355/2668] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 14:19:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:11.094643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:11.106845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5758e3-a14f-42cb-b46f-fd70be30eee1 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:11.112094 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef97ad-3289-4beb-aec4-0c3dbcddba2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d55235b0374bfa8ea73ac3f4e2836b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:11.112761 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef97ad-3289-4beb-aec4-0c3dbcddba2f service swift] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:11.113058 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef97ad-3289-4beb-aec4-0c3dbcddba2f service swift] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:11.113324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef97ad-3289-4beb-aec4-0c3dbcddba2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:11.121825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef97ad-3289-4beb-aec4-0c3dbcddba2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:11.123404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef97ad-3289-4beb-aec4-0c3dbcddba2f service swift] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:11.131388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1314/2669] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 14:19:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:16.164714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85b199-842e-4a4a-a3ff-559b80944471 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:16.178017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85b199-842e-4a4a-a3ff-559b80944471 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:16.184268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:16.184946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:16.185331 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:16.185648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:16.187515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:16.202259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:16.203928 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:16.218293 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1356/2670] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:16.801096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb5b-3a1a-4373-8d9a-6ea1cf18c98d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:16.801587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb5b-3a1a-4373-8d9a-6ea1cf18c98d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:16.801703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb5b-3a1a-4373-8d9a-6ea1cf18c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:16.824349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8d2ecb5b-3a1a-4373-8d9a-6ea1cf18c98d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:16.825629 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8d2ecb5b-3a1a-4373-8d9a-6ea1cf18c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:16.834270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1315/2671] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:16.864163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:16.877759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81072da-d861-4879-becc-97a97899d2c2 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:16.886473 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:16.887195 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:16.887482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:16.887762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:16.897463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:16.899115 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:16.910452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1357/2672] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:20.998460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f98c9-4aaa-4ac0-ae35-9a5e3e373134 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:20.999010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f98c9-4aaa-4ac0-ae35-9a5e3e373134 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:20.999010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f98c9-4aaa-4ac0-ae35-9a5e3e373134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:21.018134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-702f98c9-4aaa-4ac0-ae35-9a5e3e373134 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:21.019346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-702f98c9-4aaa-4ac0-ae35-9a5e3e373134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:21.027939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1316/2673] 10.222.0.74 () {58 vars in 1016 bytes} [Mon Jul 18 14:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:21.062144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:21.073319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a75e75-05b3-4ba5-98a3-50da97f5e7c5 service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:21.078711 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:21.079373 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:21.079660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:21.079925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:21.090035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:21.091687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:21.102052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1358/2674] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:22.456034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f98c9-4aaa-4ac0-ae35-9a5e3e373134 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:22.466994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f98c9-4aaa-4ac0-ae35-9a5e3e373134 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:22.470517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:22.471189 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:22.471470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:22.471746 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:22.473569 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:22.485777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:22.487194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:22.497731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1317/2675] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:25.704194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:25.705801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:25.714379 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=31 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:25.720744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d406d8-aabc-4da7-92cc-86e15641e5ee service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:25.725808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:25.726673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:25.726950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:25.727223 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] PATH_INFO: `/v3/users/ab8bc4faa499494f93571797e3c89e84` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:25.728759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8bc4faa499494f93571797e3c89e84)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:25.730725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:25.779973 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8bc4faa499494f93571797e3c89e84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:25.788275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8bc4faa499494f93571797e3c89e84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:25.789190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8bc4faa499494f93571797e3c89e84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:25.802913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8bc4faa499494f93571797e3c89e84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:25.803671 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-055d84f5-7ed6-4caf-8362-721e1e880a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8bc4faa499494f93571797e3c89e84'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:25.817950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1359/2676] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:25 2022] DELETE /identity/v3/users/ab8bc4faa499494f93571797e3c89e84 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:26.001877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.019053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63391c-e4bd-47e1-a97f-cea0c51b19c4 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.081379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.082267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.083150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.083494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] PATH_INFO: `/v3/projects/0f6178c87705428a9e3986ed0a1f517e` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.084800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f6178c87705428a9e3986ed0a1f517e)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.087644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.138765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f6178c87705428a9e3986ed0a1f517e', 'request_id': 'req-83d7e822-614c-46cf-a111-4a94c97e7dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:26.146221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f6178c87705428a9e3986ed0a1f517e', 'request_id': 'req-83d7e822-614c-46cf-a111-4a94c97e7dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:26.152449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f6178c87705428a9e3986ed0a1f517e', 'request_id': 'req-83d7e822-614c-46cf-a111-4a94c97e7dd6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:26.163679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] The token cache is being invalidate because project 0f6178c87705428a9e3986ed0a1f517e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:26.163965 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:26.164592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-83d7e822-614c-46cf-a111-4a94c97e7dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:26.166551 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1318/2677] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:26 2022] DELETE /identity/v3/projects/0f6178c87705428a9e3986ed0a1f517e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:26.171660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179703ce-06b1-4ed5-9f97-3832f98f29ec None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.171955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179703ce-06b1-4ed5-9f97-3832f98f29ec None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.172236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179703ce-06b1-4ed5-9f97-3832f98f29ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.195946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-179703ce-06b1-4ed5-9f97-3832f98f29ec None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:26.197968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-179703ce-06b1-4ed5-9f97-3832f98f29ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:26.262941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1360/2678] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:26.271036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cbe1-77b9-44ef-951e-833117aa61ce None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.271358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cbe1-77b9-44ef-951e-833117aa61ce None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.271664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20cbe1-77b9-44ef-951e-833117aa61ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.291437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-bc20cbe1-77b9-44ef-951e-833117aa61ce None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:26.292738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-bc20cbe1-77b9-44ef-951e-833117aa61ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:26.301540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1319/2679] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:26.306570 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179703ce-06b1-4ed5-9f97-3832f98f29ec None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.317582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179703ce-06b1-4ed5-9f97-3832f98f29ec None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.324132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.324805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.325083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.325382 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.326114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:26.326420 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.328019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.340529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1361/2680] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:19:26.345042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20cbe1-77b9-44ef-951e-833117aa61ce None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.355539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20cbe1-77b9-44ef-951e-833117aa61ce None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.360306 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.360962 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.361242 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.361544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.362262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.364141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.373742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:26.406289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1320/2681] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:26 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:26.410564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.422744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0dcee-0d40-45ba-9881-0238aacb3c90 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.484646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.485322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.485633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.485940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.486600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.488507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.497624 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:26.518651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1362/2682] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:26 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:26.519968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.532901 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937aded-4a79-458d-9308-0de8bc221252 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.538292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.538967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.539577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.539577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.541458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.543400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.555010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1321/2683] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:26.559712 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.573168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6253e-3fa8-4e11-8bb5-bacd8402c487 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.578039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e163a-a27d-4718-9f92-b831218ceb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.578779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e163a-a27d-4718-9f92-b831218ceb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.579153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e163a-a27d-4718-9f92-b831218ceb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.579500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e163a-a27d-4718-9f92-b831218ceb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.580303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e163a-a27d-4718-9f92-b831218ceb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.582017 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e163a-a27d-4718-9f92-b831218ceb36 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.596769 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1363/2684] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:19:26.597891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.608963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2b067-f6e0-48f6-aab4-88fe5f906bde admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.613777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.614656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.614937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.615210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] PATH_INFO: `/v3/projects/e0f10dffb1af45a0b38be3dfd8d8fa94/users/ce3f569879934f81bddabe61fee2cf89/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.631752 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f10dffb1af45a0b38be3dfd8d8fa94, user_id=ce3f569879934f81bddabe61fee2cf89, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.635135 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.649255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1322/2685] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:26 2022] PUT /identity/v3/projects/e0f10dffb1af45a0b38be3dfd8d8fa94/users/ce3f569879934f81bddabe61fee2cf89/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:26.660682 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83607cdd-b3fd-4d88-aa8a-193e8a7baaa3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.661059 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83607cdd-b3fd-4d88-aa8a-193e8a7baaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.661437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83607cdd-b3fd-4d88-aa8a-193e8a7baaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.693585 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-83607cdd-b3fd-4d88-aa8a-193e8a7baaa3 None None] MFA Rules not processed for user `ce3f569879934f81bddabe61fee2cf89`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:26.695125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-83607cdd-b3fd-4d88-aa8a-193e8a7baaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:26.760003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1364/2686] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:26.771612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:26.773338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:26.853834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b91ee-c628-4a5d-ab57-03852a9b3350 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:26.859359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c55c7-5c74-4bc7-8280-a0f43eb6e514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:26.860011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c55c7-5c74-4bc7-8280-a0f43eb6e514 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:26.860299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c55c7-5c74-4bc7-8280-a0f43eb6e514 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:26.860582 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c55c7-5c74-4bc7-8280-a0f43eb6e514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:26.869295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c55c7-5c74-4bc7-8280-a0f43eb6e514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:26.871019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c55c7-5c74-4bc7-8280-a0f43eb6e514 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:26.880430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1323/2687] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:29.573405 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83607cdd-b3fd-4d88-aa8a-193e8a7baaa3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:29.633412 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83607cdd-b3fd-4d88-aa8a-193e8a7baaa3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:29.638118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:29.639011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:29.639296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:29.639575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] PATH_INFO: `/v3/users/ce3f569879934f81bddabe61fee2cf89` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:29.640754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3f569879934f81bddabe61fee2cf89)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:29.642925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:29.691748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3f569879934f81bddabe61fee2cf89'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:29.699220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3f569879934f81bddabe61fee2cf89'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:29.699814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3f569879934f81bddabe61fee2cf89'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:29.711599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3f569879934f81bddabe61fee2cf89'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:29.712234 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3f569879934f81bddabe61fee2cf89'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:29.713666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:29.727408 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1365/2688] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:29 2022] DELETE /identity/v3/users/ce3f569879934f81bddabe61fee2cf89 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:29.732607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:29.733095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:29.733424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:29.751067 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:29.752271 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:29.811101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1324/2689] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:29.820695 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:29.822174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:29.880560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986f6d3-6e81-4d97-8c1e-c2152c086369 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:29.884242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f018a-4cee-46e2-bc96-ab9bb4d19358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:29.884886 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f018a-4cee-46e2-bc96-ab9bb4d19358 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:29.885170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f018a-4cee-46e2-bc96-ab9bb4d19358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:29.885623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f018a-4cee-46e2-bc96-ab9bb4d19358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:29.895067 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f018a-4cee-46e2-bc96-ab9bb4d19358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:29.896483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f018a-4cee-46e2-bc96-ab9bb4d19358 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:29.906345 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1366/2690] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:30.257100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.258660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:30.271648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908274d-4f1b-4904-8892-c192c934e143 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.276817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.278505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.278505 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.278839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] PATH_INFO: `/v3/projects/e0f10dffb1af45a0b38be3dfd8d8fa94` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.280108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f10dffb1af45a0b38be3dfd8d8fa94)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.282079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.313702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:30.333124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f10dffb1af45a0b38be3dfd8d8fa94', 'request_id': 'req-5633e5ba-0b13-400e-8691-41fb85439ecf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:30.341185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f10dffb1af45a0b38be3dfd8d8fa94', 'request_id': 'req-5633e5ba-0b13-400e-8691-41fb85439ecf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:30.346834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f10dffb1af45a0b38be3dfd8d8fa94', 'request_id': 'req-5633e5ba-0b13-400e-8691-41fb85439ecf'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:30.358182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] The token cache is being invalidate because project e0f10dffb1af45a0b38be3dfd8d8fa94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:30.358469 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:30.359109 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5633e5ba-0b13-400e-8691-41fb85439ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:30.360652 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1325/2691] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:30 2022] DELETE /identity/v3/projects/e0f10dffb1af45a0b38be3dfd8d8fa94 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:30.365749 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d9f8-5b3b-4323-8958-25c494aa3570 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.366040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d9f8-5b3b-4323-8958-25c494aa3570 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.366317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3d9f8-5b3b-4323-8958-25c494aa3570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.384413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-00f3d9f8-5b3b-4323-8958-25c494aa3570 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:30.386168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-00f3d9f8-5b3b-4323-8958-25c494aa3570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:30.456940 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1367/2692] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:30.465053 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac520f-4f07-4261-9612-c2db68e581e8 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.465356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac520f-4f07-4261-9612-c2db68e581e8 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.465649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac520f-4f07-4261-9612-c2db68e581e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.484174 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-7fac520f-4f07-4261-9612-c2db68e581e8 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:30.485411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7fac520f-4f07-4261-9612-c2db68e581e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:30.493201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1326/2693] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:30.498308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d9f8-5b3b-4323-8958-25c494aa3570 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.507896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3d9f8-5b3b-4323-8958-25c494aa3570 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.512568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.513214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.513529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.513805 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.514521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:30.514822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.516404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.527885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1368/2694] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:19:30.532029 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac520f-4f07-4261-9612-c2db68e581e8 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.541293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac520f-4f07-4261-9612-c2db68e581e8 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.546964 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.547620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.547906 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.548183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.548876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.550832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.579907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1327/2695] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:30 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:30.580898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.591140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4e12-c7ae-4c4f-b270-03ddc56af953 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.647138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.647801 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.648079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.648352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.649040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.651082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.671667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1369/2696] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:30 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:30.675728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.687229 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be73206-cbce-4cdf-9ac0-b2a9aa78904a admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.691877 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.692528 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.692808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.693084 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.693861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.695440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.706238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1328/2697] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:30.710153 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.721222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406933f9-d31b-43f7-8859-21bcf957ae70 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.726031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ffdda-cf0e-4f4f-9065-50e50af953d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.726689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffdda-cf0e-4f4f-9065-50e50af953d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.726962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffdda-cf0e-4f4f-9065-50e50af953d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.727243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ffdda-cf0e-4f4f-9065-50e50af953d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.727962 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ffdda-cf0e-4f4f-9065-50e50af953d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.730424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ffdda-cf0e-4f4f-9065-50e50af953d2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.732677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:30.743144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1370/2698] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:30.747620 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.764584 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7b66b-9af9-4266-bc82-98d852ad3217 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.769487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.770380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.770664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.770943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] PATH_INFO: `/v3/projects/0c676aa2b0424ef9b6e94d145c73fc00/users/b9d9717f7932419cb6b146a9fd32456f/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.786161 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c676aa2b0424ef9b6e94d145c73fc00, user_id=b9d9717f7932419cb6b146a9fd32456f, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.788820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.802650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1329/2699] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:30 2022] PUT /identity/v3/projects/0c676aa2b0424ef9b6e94d145c73fc00/users/b9d9717f7932419cb6b146a9fd32456f/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:30.813214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a3a0-2303-48c1-a463-750c1dba75fe None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.813535 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a3a0-2303-48c1-a463-750c1dba75fe None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.813810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650a3a0-2303-48c1-a463-750c1dba75fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.840961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7650a3a0-2303-48c1-a463-750c1dba75fe None None] MFA Rules not processed for user `b9d9717f7932419cb6b146a9fd32456f`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:30.842147 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7650a3a0-2303-48c1-a463-750c1dba75fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:30.905350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1371/2700] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:30.911269 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.975293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2e097-56d3-4c06-b39a-5fc739dae667 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.980648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.981404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.981686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.981963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.982651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.984557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.008923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1330/2701] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:30 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:31.012983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a3a0-2303-48c1-a463-750c1dba75fe None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.023527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650a3a0-2303-48c1-a463-750c1dba75fe None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.093311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.094050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.094333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.094609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.095306 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.097240 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.118606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1372/2702] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:31 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:31.122976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.133186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d0f9e-2512-42ea-aa43-c648633609e9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.138649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.139295 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.139578 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.139861 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.140585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.142223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.153771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1331/2703] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:31.157828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.167862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa082ae5-ec7b-4443-9b52-20c060e50705 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.172406 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.173269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.173578 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.173847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] PATH_INFO: `/v3/projects/46b361c16d79431d9bc7d13d9203836a/users/12ad7e762834417cb4473a17348d9628/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.188552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b361c16d79431d9bc7d13d9203836a, user_id=12ad7e762834417cb4473a17348d9628, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.191194 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.204506 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1373/2704] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:31 2022] PUT /identity/v3/projects/46b361c16d79431d9bc7d13d9203836a/users/12ad7e762834417cb4473a17348d9628/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:31.208424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.219756 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ac735-29f2-4386-870e-92338ee7e5d1 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.241373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:31.285604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9265-d170-45fc-a4eb-da2d947de777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.286396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9265-d170-45fc-a4eb-da2d947de777 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.286778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9265-d170-45fc-a4eb-da2d947de777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.287155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9265-d170-45fc-a4eb-da2d947de777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.287985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a9265-d170-45fc-a4eb-da2d947de777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.289742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a9265-d170-45fc-a4eb-da2d947de777 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.304050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1332/2705] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:31.305463 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.316484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe68fe-326e-4053-a8e1-f39079220ea9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.321187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.324832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.324832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.324832 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] PATH_INFO: `/v3/projects/46b361c16d79431d9bc7d13d9203836a/users/12ad7e762834417cb4473a17348d9628/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.325729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b361c16d79431d9bc7d13d9203836a, user_id=12ad7e762834417cb4473a17348d9628, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.328341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.340348 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1374/2706] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:31 2022] PUT /identity/v3/projects/46b361c16d79431d9bc7d13d9203836a/users/12ad7e762834417cb4473a17348d9628/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:31.351118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1000-86ba-4885-bc82-fc012b1dc6f6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.351343 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1000-86ba-4885-bc82-fc012b1dc6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.351627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1000-86ba-4885-bc82-fc012b1dc6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.383015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c8bf1000-86ba-4885-bc82-fc012b1dc6f6 None None] MFA Rules not processed for user `12ad7e762834417cb4473a17348d9628`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:31.384367 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c8bf1000-86ba-4885-bc82-fc012b1dc6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:31.457942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1333/2707] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:31.468687 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.470445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:31.513938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:31.529042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391036e9-4808-4200-ae22-7fae25b31529 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.532666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed6665-1501-4899-bc84-b72eaef79370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.533333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6665-1501-4899-bc84-b72eaef79370 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.533641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6665-1501-4899-bc84-b72eaef79370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.533912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed6665-1501-4899-bc84-b72eaef79370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.543150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed6665-1501-4899-bc84-b72eaef79370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.544566 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed6665-1501-4899-bc84-b72eaef79370 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.553963 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1375/2708] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:31 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:31.714974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1000-86ba-4885-bc82-fc012b1dc6f6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.776571 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1000-86ba-4885-bc82-fc012b1dc6f6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.781241 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.782149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.782432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.782712 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] PATH_INFO: `/v3/users/b9d9717f7932419cb6b146a9fd32456f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.783914 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d9717f7932419cb6b146a9fd32456f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.785943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.831865 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d9717f7932419cb6b146a9fd32456f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:31.833597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:31.839832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d9717f7932419cb6b146a9fd32456f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:31.840737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d9717f7932419cb6b146a9fd32456f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:31.841371 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d9717f7932419cb6b146a9fd32456f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:31.848785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d9717f7932419cb6b146a9fd32456f'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:31.872055 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1334/2709] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:31 2022] DELETE /identity/v3/users/b9d9717f7932419cb6b146a9fd32456f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:31.876607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.877105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.877211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.894882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:31.896103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:31.955662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1376/2710] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:31.965751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.967370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:32.025363 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1017e6f-c44e-43da-949b-378f0f37794e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:32.030414 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:32.031068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:32.031352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:32.031625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:32.040721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:32.043086 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:32.052640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1335/2711] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:19:32.328954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:32.330494 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:32.347210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb09c8-6c7f-466d-838c-d542fb712946 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:32.352079 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:32.353196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:32.353651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:32.354024 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] PATH_INFO: `/v3/projects/0c676aa2b0424ef9b6e94d145c73fc00` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:32.355189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c676aa2b0424ef9b6e94d145c73fc00)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:32.357078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:32.404767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c676aa2b0424ef9b6e94d145c73fc00', 'request_id': 'req-2081785e-ebd7-4222-8823-5711983454ab'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.410242 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c676aa2b0424ef9b6e94d145c73fc00', 'request_id': 'req-2081785e-ebd7-4222-8823-5711983454ab'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.418073 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c676aa2b0424ef9b6e94d145c73fc00', 'request_id': 'req-2081785e-ebd7-4222-8823-5711983454ab'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.431190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] The token cache is being invalidate because project 0c676aa2b0424ef9b6e94d145c73fc00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:32.431456 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.432114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.434664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1377/2712] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:32 2022] DELETE /identity/v3/projects/0c676aa2b0424ef9b6e94d145c73fc00 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:32.438863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:32.450121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ca7c4-2b4b-4508-8f91-3308a1a823bb service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:32.513857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:32.514733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:32.515016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:32.515292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] PATH_INFO: `/v3/users/12ad7e762834417cb4473a17348d9628` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:32.516506 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ad7e762834417cb4473a17348d9628)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:32.518484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:32.568359 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ad7e762834417cb4473a17348d9628'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.577336 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ad7e762834417cb4473a17348d9628'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.578042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ad7e762834417cb4473a17348d9628'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.578583 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ad7e762834417cb4473a17348d9628'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.585841 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-30bbc993-647f-48df-96d0-da6b4d33db23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ad7e762834417cb4473a17348d9628'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:32.592102 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:32.609150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1336/2713] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:32 2022] DELETE /identity/v3/users/12ad7e762834417cb4473a17348d9628 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:32.890113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:32.894577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:32.905386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081785e-ebd7-4222-8823-5711983454ab admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:32.964316 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:32.965485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:32.965772 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:32.966052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] PATH_INFO: `/v3/projects/46b361c16d79431d9bc7d13d9203836a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:32.967244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b361c16d79431d9bc7d13d9203836a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:32.969138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:32.976941 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:33.016437 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b361c16d79431d9bc7d13d9203836a', 'request_id': 'req-56ffe78b-d592-4e31-9c34-102fb52e23de'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:33.021904 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b361c16d79431d9bc7d13d9203836a', 'request_id': 'req-56ffe78b-d592-4e31-9c34-102fb52e23de'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:33.030003 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b361c16d79431d9bc7d13d9203836a', 'request_id': 'req-56ffe78b-d592-4e31-9c34-102fb52e23de'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:33.040990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] The token cache is being invalidate because project 46b361c16d79431d9bc7d13d9203836a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:33.041294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:33.042074 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-56ffe78b-d592-4e31-9c34-102fb52e23de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:33.044326 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1378/2714] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:32 2022] DELETE /identity/v3/projects/46b361c16d79431d9bc7d13d9203836a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:33.049239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7f60-ae64-43ea-90c6-e9efcb3f46b7 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.049733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7f60-ae64-43ea-90c6-e9efcb3f46b7 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.049870 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd7f60-ae64-43ea-90c6-e9efcb3f46b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.069560 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-d7fd7f60-ae64-43ea-90c6-e9efcb3f46b7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:33.070765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-d7fd7f60-ae64-43ea-90c6-e9efcb3f46b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:33.131012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1337/2715] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:33.139265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71474d2-020c-4f50-a6a6-68e6f5394a6a None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.139552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71474d2-020c-4f50-a6a6-68e6f5394a6a None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.139829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71474d2-020c-4f50-a6a6-68e6f5394a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.160362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-f71474d2-020c-4f50-a6a6-68e6f5394a6a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:33.161609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-f71474d2-020c-4f50-a6a6-68e6f5394a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:33.170572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1379/2716] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:33.176133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd7f60-ae64-43ea-90c6-e9efcb3f46b7 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.188059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd7f60-ae64-43ea-90c6-e9efcb3f46b7 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.192805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.193499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.193786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.194066 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.194798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:33.195108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.196808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.208606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1338/2717] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:19:33.212879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71474d2-020c-4f50-a6a6-68e6f5394a6a None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.222815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71474d2-020c-4f50-a6a6-68e6f5394a6a None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.227449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.228096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.228375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.228652 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.229330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.231929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.257087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1380/2718] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:33.261859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.271859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514af2ce-90c2-4d34-9775-b166bccade0b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.329649 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.330325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.330609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.330887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.331587 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.333549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.352820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1339/2719] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:33.357451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.367495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0bd9e-3e34-4700-b9b2-72f230244e01 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.372964 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.373655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.373932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.374200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.374915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.376493 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.386864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1381/2720] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:33.390668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.400565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65243d79-7746-4ccb-8378-447ef3dbae00 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.405585 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f2a96-92c7-4dd7-8b1f-608fd04f9687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.406263 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2a96-92c7-4dd7-8b1f-608fd04f9687 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.406546 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2a96-92c7-4dd7-8b1f-608fd04f9687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.406823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f2a96-92c7-4dd7-8b1f-608fd04f9687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.407547 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2a96-92c7-4dd7-8b1f-608fd04f9687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.409137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f2a96-92c7-4dd7-8b1f-608fd04f9687 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.419687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1340/2721] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:33.423610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.434882 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b3ef7-dee8-44dd-9094-d6b07c51987c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.439590 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.440604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.440887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.441163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] PATH_INFO: `/v3/projects/bf42b32e87a4445dbc68772eeba517f0/users/1bc24daac8dc4153bbc37a3137f8d83c/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.456714 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf42b32e87a4445dbc68772eeba517f0, user_id=1bc24daac8dc4153bbc37a3137f8d83c, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.459371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.471938 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1382/2722] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:33 2022] PUT /identity/v3/projects/bf42b32e87a4445dbc68772eeba517f0/users/1bc24daac8dc4153bbc37a3137f8d83c/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:33.485083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cb72e-b00a-4c1d-addc-1c3abaaa32f1 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.485304 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cb72e-b00a-4c1d-addc-1c3abaaa32f1 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.485616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cb72e-b00a-4c1d-addc-1c3abaaa32f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.520238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-e39cb72e-b00a-4c1d-addc-1c3abaaa32f1 None None] MFA Rules not processed for user `1bc24daac8dc4153bbc37a3137f8d83c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:33.521522 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e39cb72e-b00a-4c1d-addc-1c3abaaa32f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:33.564182 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:33.588832 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1341/2723] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:33.593251 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.659481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b9b91-4bc0-447f-b1e8-3da7aadcb8ca admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.664380 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.665640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.665640 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.665858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.666620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.669213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.698555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1383/2724] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:33.702596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cb72e-b00a-4c1d-addc-1c3abaaa32f1 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.716535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cb72e-b00a-4c1d-addc-1c3abaaa32f1 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.783953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.790181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.790662 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.791034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.791883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.794659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.818748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1342/2725] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:33.819841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.830875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f0c38-b5b9-49be-a306-6b3290a8cf25 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.835533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.836657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.836657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.836878 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.837531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.839786 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.850303 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1384/2726] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:33.855423 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.865602 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445fac-4f25-4beb-b9af-c5b684d51f19 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.870933 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.871889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.872177 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.872451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] PATH_INFO: `/v3/projects/e4e2edb7dd7443c5a647ab349daf93a4/users/785d222745f240e6a3f04d2376c9d4d5/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.888499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e2edb7dd7443c5a647ab349daf93a4, user_id=785d222745f240e6a3f04d2376c9d4d5, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.891063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.906404 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1343/2727] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:33 2022] PUT /identity/v3/projects/e4e2edb7dd7443c5a647ab349daf93a4/users/785d222745f240e6a3f04d2376c9d4d5/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:33.910451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.920732 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25aa0b-3455-4e4f-87c7-4d5ae7e16b2d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.925042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:33.987932 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae26cf-e290-439e-9c43-e84a81f51657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.988627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae26cf-e290-439e-9c43-e84a81f51657 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.988902 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae26cf-e290-439e-9c43-e84a81f51657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.989174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae26cf-e290-439e-9c43-e84a81f51657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.989926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae26cf-e290-439e-9c43-e84a81f51657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.991533 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae26cf-e290-439e-9c43-e84a81f51657 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:34.001833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1385/2728] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:19:34.006213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:34.019719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ee50-cd81-486d-a9b9-b3c57e746d27 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:34.025451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:34.026221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:34.026630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:34.026922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] PATH_INFO: `/v3/projects/e4e2edb7dd7443c5a647ab349daf93a4/users/785d222745f240e6a3f04d2376c9d4d5/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:34.029460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e2edb7dd7443c5a647ab349daf93a4, user_id=785d222745f240e6a3f04d2376c9d4d5, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:34.032092 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:34.044215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1344/2729] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:34 2022] PUT /identity/v3/projects/e4e2edb7dd7443c5a647ab349daf93a4/users/785d222745f240e6a3f04d2376c9d4d5/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:34.055154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0c89-4371-4c75-b431-d25d511bf2e9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:34.055439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0c89-4371-4c75-b431-d25d511bf2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:34.055734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0c89-4371-4c75-b431-d25d511bf2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:34.088592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-68ae0c89-4371-4c75-b431-d25d511bf2e9 None None] MFA Rules not processed for user `785d222745f240e6a3f04d2376c9d4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:34.090660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-68ae0c89-4371-4c75-b431-d25d511bf2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:34.177567 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1386/2730] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:34.189050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:34.191215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:34.250696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca3ff-f140-4990-8e71-d0326709085b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:34.254401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:34.255060 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:34.255346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:34.255630 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:34.265887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:34.267324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:34.277839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1345/2731] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:34.377924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae0c89-4371-4c75-b431-d25d511bf2e9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:34.387982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae0c89-4371-4c75-b431-d25d511bf2e9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:34.391559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989fe09-e4b7-4cda-bf9b-7b9982344497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:34.392191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fe09-e4b7-4cda-bf9b-7b9982344497 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:34.392468 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fe09-e4b7-4cda-bf9b-7b9982344497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:34.392739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989fe09-e4b7-4cda-bf9b-7b9982344497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:34.450660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989fe09-e4b7-4cda-bf9b-7b9982344497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:34.452085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989fe09-e4b7-4cda-bf9b-7b9982344497 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:34.460994 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1387/2732] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:37.026633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:37.070453 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:37.095398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f3ffc-2394-477b-93b6-376a21d70f4a service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:37.100418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:37.101324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:37.101631 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:37.101907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] PATH_INFO: `/v3/users/1bc24daac8dc4153bbc37a3137f8d83c` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:37.103080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc24daac8dc4153bbc37a3137f8d83c)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:37.104977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:37.151088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc24daac8dc4153bbc37a3137f8d83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.160289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc24daac8dc4153bbc37a3137f8d83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.160937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc24daac8dc4153bbc37a3137f8d83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.161666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc24daac8dc4153bbc37a3137f8d83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.168881 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc24daac8dc4153bbc37a3137f8d83c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.186390 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1346/2733] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:37 2022] DELETE /identity/v3/users/1bc24daac8dc4153bbc37a3137f8d83c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:37.190848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:37.191322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:37.191426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:37.210298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:37.211483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:37.231809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=100 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:37.273424 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1388/2734] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:37.283477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:37.284991 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:37.347574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c8bac-6cf1-49dd-bbe1-e97890111894 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:37.352004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:37.352658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:37.352943 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:37.353520 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:37.363941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:37.365401 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:37.378267 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1347/2735] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:37.658670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:37.660159 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:37.673925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4f761-91c1-40b1-ad33-c9378996b5eb None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:37.678703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:37.679607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:37.679885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:37.680660 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] PATH_INFO: `/v3/projects/bf42b32e87a4445dbc68772eeba517f0` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:37.681983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf42b32e87a4445dbc68772eeba517f0)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:37.684249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:37.733403 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf42b32e87a4445dbc68772eeba517f0', 'request_id': 'req-2dcf195d-1cdc-408a-9612-02c9a4782943'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.739737 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf42b32e87a4445dbc68772eeba517f0', 'request_id': 'req-2dcf195d-1cdc-408a-9612-02c9a4782943'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.747278 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf42b32e87a4445dbc68772eeba517f0', 'request_id': 'req-2dcf195d-1cdc-408a-9612-02c9a4782943'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.758620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] The token cache is being invalidate because project bf42b32e87a4445dbc68772eeba517f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:37.758914 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.759549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.761085 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1389/2736] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:37 2022] DELETE /identity/v3/projects/bf42b32e87a4445dbc68772eeba517f0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:37.765509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:37.775316 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ed029-6f17-4a86-8ab9-252806f1ef8b service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:37.833280 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:37.834183 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:37.834465 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:37.834742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] PATH_INFO: `/v3/users/785d222745f240e6a3f04d2376c9d4d5` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:37.835904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785d222745f240e6a3f04d2376c9d4d5)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:37.837912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:37.839683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:37.883873 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785d222745f240e6a3f04d2376c9d4d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.895541 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785d222745f240e6a3f04d2376c9d4d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.897636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785d222745f240e6a3f04d2376c9d4d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.897636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785d222745f240e6a3f04d2376c9d4d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.907130 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-8124a675-9e75-4e62-84b3-e4203467f3c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785d222745f240e6a3f04d2376c9d4d5'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:37.926233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1348/2737] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:37 2022] DELETE /identity/v3/users/785d222745f240e6a3f04d2376c9d4d5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:38.208987 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.210560 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:38.224197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf195d-1cdc-408a-9612-02c9a4782943 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:38.287155 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:38.288027 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.288309 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.288588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] PATH_INFO: `/v3/projects/e4e2edb7dd7443c5a647ab349daf93a4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.289854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e2edb7dd7443c5a647ab349daf93a4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:38.291765 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:38.341874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e2edb7dd7443c5a647ab349daf93a4', 'request_id': 'req-ba85459a-02c4-4f0f-b23f-66655674c382'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:38.343804 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:38.348602 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e2edb7dd7443c5a647ab349daf93a4', 'request_id': 'req-ba85459a-02c4-4f0f-b23f-66655674c382'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:38.356311 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e2edb7dd7443c5a647ab349daf93a4', 'request_id': 'req-ba85459a-02c4-4f0f-b23f-66655674c382'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:38.367272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] The token cache is being invalidate because project e4e2edb7dd7443c5a647ab349daf93a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:38.367561 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:38.368192 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ba85459a-02c4-4f0f-b23f-66655674c382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:38.369781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1390/2738] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:38 2022] DELETE /identity/v3/projects/e4e2edb7dd7443c5a647ab349daf93a4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:38.375344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e40bb-1870-4de3-a594-ea3937b19165 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.375837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e40bb-1870-4de3-a594-ea3937b19165 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.375952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e40bb-1870-4de3-a594-ea3937b19165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.393974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-4d6e40bb-1870-4de3-a594-ea3937b19165 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:38.395176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-4d6e40bb-1870-4de3-a594-ea3937b19165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:38.455325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1349/2739] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:38.462838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1820-c73c-4777-9367-78b50f641c85 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.463135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1820-c73c-4777-9367-78b50f641c85 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.463449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf1820-c73c-4777-9367-78b50f641c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.486458 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-7ddf1820-c73c-4777-9367-78b50f641c85 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:38.487681 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-7ddf1820-c73c-4777-9367-78b50f641c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:38.495976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1391/2740] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:38.501050 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e40bb-1870-4de3-a594-ea3937b19165 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.511012 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e40bb-1870-4de3-a594-ea3937b19165 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:38.516134 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:38.516790 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.517075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.517381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.518110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:38.518418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:38.520027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:38.534009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1350/2741] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:19:38.538357 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf1820-c73c-4777-9367-78b50f641c85 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.549261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf1820-c73c-4777-9367-78b50f641c85 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:38.556527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:38.557206 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.557552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.557830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.558563 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:38.561957 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:38.589337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1392/2742] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:38 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:38.594447 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.604607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2736f14-c1d9-4ff3-a063-dc84d29ebfa6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:38.666246 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:38.666918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.667202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.667477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.668745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:38.671073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:38.681194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:38.695082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1351/2743] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:38 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:38.699579 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.710565 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697ba72-32a0-477a-a253-7e2257fe1d4e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:38.716144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:38.716843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.717167 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.717470 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.718196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:38.719849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:38.732771 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1393/2744] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:38.736880 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.748100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c2f02-9bb3-4521-9321-53dee99e0ac2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:38.752988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799c9bd-5a6b-401b-a5bd-1c08d931d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:38.753681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c9bd-5a6b-401b-a5bd-1c08d931d955 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.753967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c9bd-5a6b-401b-a5bd-1c08d931d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.754247 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c9bd-5a6b-401b-a5bd-1c08d931d955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.754983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799c9bd-5a6b-401b-a5bd-1c08d931d955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:38.756598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799c9bd-5a6b-401b-a5bd-1c08d931d955 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:38.769083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1352/2745] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:38.777025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.787726 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123cc3e-12f2-49ba-9f22-63867a9f6a2f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:38.792445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:38.794082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.794552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.795046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] PATH_INFO: `/v3/projects/1733afa7dc6b473a89c98c499651ce3a/users/8bf0ff84e28e4512b90c64e59c2d9de4/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.813557 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1733afa7dc6b473a89c98c499651ce3a, user_id=8bf0ff84e28e4512b90c64e59c2d9de4, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:38.816224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:38.834065 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1394/2746] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:38 2022] PUT /identity/v3/projects/1733afa7dc6b473a89c98c499651ce3a/users/8bf0ff84e28e4512b90c64e59c2d9de4/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:38.845995 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba3073-fd99-4230-b17d-b6370f25a926 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.846289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba3073-fd99-4230-b17d-b6370f25a926 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.846575 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba3073-fd99-4230-b17d-b6370f25a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.874705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-0fba3073-fd99-4230-b17d-b6370f25a926 None None] MFA Rules not processed for user `8bf0ff84e28e4512b90c64e59c2d9de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:38.875969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0fba3073-fd99-4230-b17d-b6370f25a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:38.941292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1353/2747] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:38.945815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:39.007185 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e401ed-b7a1-45d0-a017-9011f1bd477c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.011718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.012551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.012830 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.013099 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.013828 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.015708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.041725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1395/2748] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:38 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:39.046781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba3073-fd99-4230-b17d-b6370f25a926 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:39.057592 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba3073-fd99-4230-b17d-b6370f25a926 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.115220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.115896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.116181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.116462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.117185 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.119149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.140239 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1354/2749] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:39 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:39.144307 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:39.154646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2ed9-cee4-4ecc-87ce-75e293977087 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.159188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.159837 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.160114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.160387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.161103 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.162734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.173896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1396/2750] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:39.178033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:39.188707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38b7a-8f42-4346-b6cb-f794d18f775f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.193490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.194372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.194657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.194945 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] PATH_INFO: `/v3/projects/fd031ab28b70434e9fef7eda8b38fc64/users/91c1320ce4a0402fb5427358744042a3/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.210775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd031ab28b70434e9fef7eda8b38fc64, user_id=91c1320ce4a0402fb5427358744042a3, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.213462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.226679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1355/2751] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:39 2022] PUT /identity/v3/projects/fd031ab28b70434e9fef7eda8b38fc64/users/91c1320ce4a0402fb5427358744042a3/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:39.230634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:39.240664 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca75e4-265f-44be-9268-dbb0ba2379bb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.286529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:39.298796 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a0f0f-4ce9-4ce7-8df8-f1f7d2235f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.299465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0f0f-4ce9-4ce7-8df8-f1f7d2235f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.299750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0f0f-4ce9-4ce7-8df8-f1f7d2235f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.300028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a0f0f-4ce9-4ce7-8df8-f1f7d2235f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.300788 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a0f0f-4ce9-4ce7-8df8-f1f7d2235f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.302423 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a0f0f-4ce9-4ce7-8df8-f1f7d2235f0c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.313448 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1397/2752] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:39.317596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:39.328176 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bb3c9-f5cb-47d6-a773-08fe006909d2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.332792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.333705 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.333989 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.334264 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] PATH_INFO: `/v3/projects/fd031ab28b70434e9fef7eda8b38fc64/users/91c1320ce4a0402fb5427358744042a3/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.336259 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd031ab28b70434e9fef7eda8b38fc64, user_id=91c1320ce4a0402fb5427358744042a3, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.338961 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.349411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1356/2753] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:39 2022] PUT /identity/v3/projects/fd031ab28b70434e9fef7eda8b38fc64/users/91c1320ce4a0402fb5427358744042a3/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:39.360302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871e71-3f27-41d2-8953-6fa04e252169 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.360599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871e71-3f27-41d2-8953-6fa04e252169 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.360885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12871e71-3f27-41d2-8953-6fa04e252169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.387780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-12871e71-3f27-41d2-8953-6fa04e252169 None None] MFA Rules not processed for user `91c1320ce4a0402fb5427358744042a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:39.388999 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-12871e71-3f27-41d2-8953-6fa04e252169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:39.456145 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1398/2754] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:39.467981 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:39.469789 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:39.500707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:39.528034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae63d0-8f21-48d2-9368-e4c5af3aa00d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.531703 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b3fc8-18f4-474b-95e0-f7a28a9f0534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.532333 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3fc8-18f4-474b-95e0-f7a28a9f0534 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.532617 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3fc8-18f4-474b-95e0-f7a28a9f0534 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.532895 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b3fc8-18f4-474b-95e0-f7a28a9f0534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.542080 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b3fc8-18f4-474b-95e0-f7a28a9f0534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.544070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b3fc8-18f4-474b-95e0-f7a28a9f0534 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.553738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1357/2755] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:40.090925 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871e71-3f27-41d2-8953-6fa04e252169 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:40.153102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12871e71-3f27-41d2-8953-6fa04e252169 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:40.157694 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:40.158574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:40.158862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:40.159144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] PATH_INFO: `/v3/users/8bf0ff84e28e4512b90c64e59c2d9de4` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:40.160358 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf0ff84e28e4512b90c64e59c2d9de4)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:40.162396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:40.208742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf0ff84e28e4512b90c64e59c2d9de4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.216029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf0ff84e28e4512b90c64e59c2d9de4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.216661 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf0ff84e28e4512b90c64e59c2d9de4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.228829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf0ff84e28e4512b90c64e59c2d9de4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.229577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf0ff84e28e4512b90c64e59c2d9de4'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.232986 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:40.247568 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1399/2756] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:40 2022] DELETE /identity/v3/users/8bf0ff84e28e4512b90c64e59c2d9de4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:40.252191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:40.252473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:40.252773 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:40.270658 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:40.271850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:40.332817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1358/2757] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:40.342846 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:40.344386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:40.404291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f41e4-166f-46ab-a7b9-349d78cfaaf1 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:40.407942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:40.408592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:40.408872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:40.409144 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:40.422133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:40.423572 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:40.433428 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1400/2758] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:19:40.701329 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:40.702796 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:40.714648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897962c8-7b57-4e43-9ce0-3d0bace27f9e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:40.719919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:40.720782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:40.721062 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:40.721338 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] PATH_INFO: `/v3/projects/1733afa7dc6b473a89c98c499651ce3a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:40.722657 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1733afa7dc6b473a89c98c499651ce3a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:40.724557 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:40.771928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1733afa7dc6b473a89c98c499651ce3a', 'request_id': 'req-9e11ddc0-92d0-47cd-a409-00d03c28ca55'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.779983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1733afa7dc6b473a89c98c499651ce3a', 'request_id': 'req-9e11ddc0-92d0-47cd-a409-00d03c28ca55'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.785618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1733afa7dc6b473a89c98c499651ce3a', 'request_id': 'req-9e11ddc0-92d0-47cd-a409-00d03c28ca55'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.797260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] The token cache is being invalidate because project 1733afa7dc6b473a89c98c499651ce3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:40.797572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.798200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.799734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1359/2759] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:40 2022] DELETE /identity/v3/projects/1733afa7dc6b473a89c98c499651ce3a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:40.803708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:40.813822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07459156-5d9b-4975-ba8d-0b51f4243851 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:40.870189 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:40.870982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:40.871267 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:40.871546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] PATH_INFO: `/v3/users/91c1320ce4a0402fb5427358744042a3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:40.872739 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91c1320ce4a0402fb5427358744042a3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:40.874678 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:40.922961 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91c1320ce4a0402fb5427358744042a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.933767 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91c1320ce4a0402fb5427358744042a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.934855 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91c1320ce4a0402fb5427358744042a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.948201 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91c1320ce4a0402fb5427358744042a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.948874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-7a939fd1-ef36-468c-aa54-2dd1f24e8d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91c1320ce4a0402fb5427358744042a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:40.962034 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1401/2760] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:40 2022] DELETE /identity/v3/users/91c1320ce4a0402fb5427358744042a3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:41.255833 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:41.257674 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:41.280243 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ddc0-92d0-47cd-a409-00d03c28ca55 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:41.333588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:41.344614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:41.345517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.345806 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.346082 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] PATH_INFO: `/v3/projects/fd031ab28b70434e9fef7eda8b38fc64` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.347266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd031ab28b70434e9fef7eda8b38fc64)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:41.349186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:41.396107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd031ab28b70434e9fef7eda8b38fc64', 'request_id': 'req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:41.403544 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd031ab28b70434e9fef7eda8b38fc64', 'request_id': 'req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:41.409212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd031ab28b70434e9fef7eda8b38fc64', 'request_id': 'req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:41.421196 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] The token cache is being invalidate because project fd031ab28b70434e9fef7eda8b38fc64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:41.421517 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:41.422165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-6c2b4887-7da2-4c2c-904f-21a5b513a0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:41.423720 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1360/2761] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:41 2022] DELETE /identity/v3/projects/fd031ab28b70434e9fef7eda8b38fc64 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:41.428529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6aef-2cad-4e34-ac3c-2ac6f8149c85 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.429051 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6aef-2cad-4e34-ac3c-2ac6f8149c85 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.429150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6aef-2cad-4e34-ac3c-2ac6f8149c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.449427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-773c6aef-2cad-4e34-ac3c-2ac6f8149c85 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:41.451302 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-773c6aef-2cad-4e34-ac3c-2ac6f8149c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:41.459869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:41.513539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1402/2762] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:41.521220 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc677d4-0878-4e09-a71e-80af5bb41e4b None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.521537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc677d4-0878-4e09-a71e-80af5bb41e4b None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.521817 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc677d4-0878-4e09-a71e-80af5bb41e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.540859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6dc677d4-0878-4e09-a71e-80af5bb41e4b None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:41.542117 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6dc677d4-0878-4e09-a71e-80af5bb41e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:41.551022 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1361/2763] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:41.555482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c6aef-2cad-4e34-ac3c-2ac6f8149c85 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:41.566283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c6aef-2cad-4e34-ac3c-2ac6f8149c85 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:41.570838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:41.571490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.571776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.572052 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.572778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:41.573082 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:41.574822 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:41.586347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1403/2764] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:19:41.591103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc677d4-0878-4e09-a71e-80af5bb41e4b None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:41.600377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc677d4-0878-4e09-a71e-80af5bb41e4b None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:41.605051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:41.606252 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.606689 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.607103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.607807 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:41.609739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:41.635308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1362/2765] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:41.640203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:41.650386 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346bb41-471c-4a1c-9d4b-1cc574206ab9 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:41.705436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:41.706094 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.706375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.706670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.707347 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:41.709235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:41.728606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1404/2766] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:41 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:41.733586 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:41.744157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f32912-00b5-4007-b432-168f6275b7b2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:41.749449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:41.750114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.750400 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.750679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.751415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:41.753016 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:41.764479 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1363/2767] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:41.768488 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:41.778854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e3331-d73d-45a3-abb2-5dcb5440097f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:41.783555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad462b9-3927-498a-8271-0dbc69273da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:41.784275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad462b9-3927-498a-8271-0dbc69273da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.784607 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad462b9-3927-498a-8271-0dbc69273da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.784953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad462b9-3927-498a-8271-0dbc69273da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.785848 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad462b9-3927-498a-8271-0dbc69273da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:41.787615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad462b9-3927-498a-8271-0dbc69273da0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:41.798529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1405/2768] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:41.802650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:41.813291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fb932-4fac-4fe5-9058-a342c9c61be9 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:41.817979 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:41.818854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.819139 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.819415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] PATH_INFO: `/v3/projects/ab4e17745c5a45bda7e1f60aec913ce4/users/33b782b4a2dc498f952a82b03c4ee252/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.833604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4e17745c5a45bda7e1f60aec913ce4, user_id=33b782b4a2dc498f952a82b03c4ee252, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:41.836251 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:41.849088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1364/2769] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:41 2022] PUT /identity/v3/projects/ab4e17745c5a45bda7e1f60aec913ce4/users/33b782b4a2dc498f952a82b03c4ee252/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:41.860836 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688bcc5-a9f3-4add-a47a-51409ba361f9 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:41.861133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688bcc5-a9f3-4add-a47a-51409ba361f9 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:41.861451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688bcc5-a9f3-4add-a47a-51409ba361f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:41.888132 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9688bcc5-a9f3-4add-a47a-51409ba361f9 None None] MFA Rules not processed for user `33b782b4a2dc498f952a82b03c4ee252`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:41.889601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9688bcc5-a9f3-4add-a47a-51409ba361f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:41.955136 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1406/2770] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:41.959645 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.023323 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec18b-ed56-4d0d-95e9-4ad88afa164b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.028721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.029399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.029686 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.029968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.030671 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.032574 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.057478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1365/2771] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:42.062371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688bcc5-a9f3-4add-a47a-51409ba361f9 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.073589 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688bcc5-a9f3-4add-a47a-51409ba361f9 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.079104 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:42.135141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.136042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.136042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.137988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.137988 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.139006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.160502 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1407/2772] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:42 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:42.164626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.173071 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:42.176994 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72391f-98f9-4191-b9df-59f03625b3fb admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.183552 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.184751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.185030 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.185449 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.186268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.188605 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.199299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1366/2773] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:42.204291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.214371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c089f-a9e5-4c0b-8673-362c2de8ae83 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.219484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.220367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.221300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.221621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] PATH_INFO: `/v3/projects/f25c9fd72232453bb808ba9d8d7aee8a/users/8924cf04f5b54b539e452f793e500dfd/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.236816 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25c9fd72232453bb808ba9d8d7aee8a, user_id=8924cf04f5b54b539e452f793e500dfd, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.239500 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.256916 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1408/2774] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:42 2022] PUT /identity/v3/projects/f25c9fd72232453bb808ba9d8d7aee8a/users/8924cf04f5b54b539e452f793e500dfd/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:42.261054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.272107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dfced-ce77-4659-b268-5c9c1a1cf2c2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.332424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e1585-fb5f-4aa3-8b64-842af4677fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.333096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e1585-fb5f-4aa3-8b64-842af4677fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.333406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e1585-fb5f-4aa3-8b64-842af4677fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.333694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e1585-fb5f-4aa3-8b64-842af4677fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.334411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e1585-fb5f-4aa3-8b64-842af4677fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.345828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e1585-fb5f-4aa3-8b64-842af4677fbf admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.347530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1367/2775] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:42.351971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.363779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df09dea-d0fb-4eca-9850-fe5dc8a2f4d3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.368906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.370288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.370674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.371048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] PATH_INFO: `/v3/projects/f25c9fd72232453bb808ba9d8d7aee8a/users/8924cf04f5b54b539e452f793e500dfd/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.374060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f25c9fd72232453bb808ba9d8d7aee8a, user_id=8924cf04f5b54b539e452f793e500dfd, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.376779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.389451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1409/2776] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:42 2022] PUT /identity/v3/projects/f25c9fd72232453bb808ba9d8d7aee8a/users/8924cf04f5b54b539e452f793e500dfd/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:42.401849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4d8d3-414b-4432-9b86-8220a66f04d6 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.402149 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4d8d3-414b-4432-9b86-8220a66f04d6 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.402428 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4d8d3-414b-4432-9b86-8220a66f04d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.430829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f4f4d8d3-414b-4432-9b86-8220a66f04d6 None None] MFA Rules not processed for user `8924cf04f5b54b539e452f793e500dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:42.432160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f4f4d8d3-414b-4432-9b86-8220a66f04d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:42.502539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1368/2777] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:42.515135 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.517068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:42.574490 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668af17-d5ee-469f-9be4-62d28e0134d2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.578896 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.579534 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.579818 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.580106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.589133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.591337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.600663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1410/2778] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:42.670011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4d8d3-414b-4432-9b86-8220a66f04d6 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:42.679573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4d8d3-414b-4432-9b86-8220a66f04d6 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:42.683173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ab61d-4d40-4e7d-8da2-2e0ab554c257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:42.683822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab61d-4d40-4e7d-8da2-2e0ab554c257 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:42.684893 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab61d-4d40-4e7d-8da2-2e0ab554c257 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:42.685170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ab61d-4d40-4e7d-8da2-2e0ab554c257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:42.743988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ab61d-4d40-4e7d-8da2-2e0ab554c257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:42.745534 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ab61d-4d40-4e7d-8da2-2e0ab554c257 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:42.755850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1369/2779] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:19:43.015404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:43.078125 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e888a0-c3d8-4267-972c-c95d34ae9c91 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:43.082997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:43.083779 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:43.084062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:43.084337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] PATH_INFO: `/v3/users/33b782b4a2dc498f952a82b03c4ee252` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:43.085613 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b782b4a2dc498f952a82b03c4ee252)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:43.087552 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:43.093112 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:43.135924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b782b4a2dc498f952a82b03c4ee252'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.142849 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b782b4a2dc498f952a82b03c4ee252'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.143605 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b782b4a2dc498f952a82b03c4ee252'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.157823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b782b4a2dc498f952a82b03c4ee252'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.158482 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b782b4a2dc498f952a82b03c4ee252'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.170983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1411/2780] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:43 2022] DELETE /identity/v3/users/33b782b4a2dc498f952a82b03c4ee252 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:43.175647 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:43.175983 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:43.176212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:43.194113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:43.195317 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:43.205137 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=100 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:43.256719 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1370/2781] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:43.266657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:43.268129 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:43.324912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc3286-c97b-49d2-92c5-8f5ccf752fe8 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:43.328608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:43.329371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:43.329651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:43.329921 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:43.338936 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:43.340407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:43.349843 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1412/2782] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:43.644235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:43.645908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:43.659678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631a2e7-33f9-46a3-acb3-ca81adde4506 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:43.664419 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:43.665291 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:43.665612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:43.665892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] PATH_INFO: `/v3/projects/ab4e17745c5a45bda7e1f60aec913ce4` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:43.667146 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4e17745c5a45bda7e1f60aec913ce4)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:43.669839 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:43.718270 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4e17745c5a45bda7e1f60aec913ce4', 'request_id': 'req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.725193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4e17745c5a45bda7e1f60aec913ce4', 'request_id': 'req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.730766 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4e17745c5a45bda7e1f60aec913ce4', 'request_id': 'req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.741936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] The token cache is being invalidate because project ab4e17745c5a45bda7e1f60aec913ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:43.742226 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.742860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.744429 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1371/2783] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:43 2022] DELETE /identity/v3/projects/ab4e17745c5a45bda7e1f60aec913ce4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:43.749060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:43.758742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50690cf9-8e01-402d-9eac-a893fc0052ab service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:43.815871 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:43.816734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:43.817016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:43.817295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] PATH_INFO: `/v3/users/8924cf04f5b54b539e452f793e500dfd` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:43.818648 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8924cf04f5b54b539e452f793e500dfd)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:43.820556 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:43.849615 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:43.868697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8924cf04f5b54b539e452f793e500dfd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.875935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8924cf04f5b54b539e452f793e500dfd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.876575 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8924cf04f5b54b539e452f793e500dfd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.888609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8924cf04f5b54b539e452f793e500dfd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.889236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-430197d4-9031-45ac-a532-99feb15f3a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8924cf04f5b54b539e452f793e500dfd'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:43.901117 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1413/2784] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:43 2022] DELETE /identity/v3/users/8924cf04f5b54b539e452f793e500dfd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:44.181650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.183093 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:44.197009 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e6f4d-ee7b-4d56-b8fb-c5abbfc7912c admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:44.256844 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:44.257683 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.257973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.258255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] PATH_INFO: `/v3/projects/f25c9fd72232453bb808ba9d8d7aee8a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.259435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f25c9fd72232453bb808ba9d8d7aee8a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:44.261339 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:44.302822 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:44.311422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f25c9fd72232453bb808ba9d8d7aee8a', 'request_id': 'req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:44.318468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f25c9fd72232453bb808ba9d8d7aee8a', 'request_id': 'req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:44.324193 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f25c9fd72232453bb808ba9d8d7aee8a', 'request_id': 'req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:44.336905 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] The token cache is being invalidate because project f25c9fd72232453bb808ba9d8d7aee8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:44.337186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:44.337836 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-b69f5775-be3a-4348-b1b3-ff0d56d9d0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:44.339473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1372/2785] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:44 2022] DELETE /identity/v3/projects/f25c9fd72232453bb808ba9d8d7aee8a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:44.344452 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf390c6-0209-42e9-baa1-c9ecb9c0389c None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.344740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf390c6-0209-42e9-baa1-c9ecb9c0389c None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.345019 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf390c6-0209-42e9-baa1-c9ecb9c0389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.363087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-cdf390c6-0209-42e9-baa1-c9ecb9c0389c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:44.364282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-cdf390c6-0209-42e9-baa1-c9ecb9c0389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:44.424114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1414/2786] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:44.486490 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f36b-23d8-464b-b51c-18e83c4fe08a None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.486784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f36b-23d8-464b-b51c-18e83c4fe08a None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.487069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f36b-23d8-464b-b51c-18e83c4fe08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.507642 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-12b5f36b-23d8-464b-b51c-18e83c4fe08a None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:44.508775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-12b5f36b-23d8-464b-b51c-18e83c4fe08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:44.517545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1373/2787] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:44.521708 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf390c6-0209-42e9-baa1-c9ecb9c0389c None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.531823 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf390c6-0209-42e9-baa1-c9ecb9c0389c None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:44.536744 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:44.537481 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.537809 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.538130 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.538968 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:44.539325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:44.541023 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:44.553451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1415/2788] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:19:44.557567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5f36b-23d8-464b-b51c-18e83c4fe08a None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.572255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5f36b-23d8-464b-b51c-18e83c4fe08a None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:44.578299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:44.578955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.578955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.579678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.580244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:44.582588 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:44.614778 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1374/2789] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:44 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:44.618985 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.629284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f339ddc-81e2-42a0-9422-29aa1d35ea7f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:44.690299 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:44.690976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.691261 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.691540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.692230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:44.694203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:44.716471 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1416/2790] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:44 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:44.720860 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.732311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68376d-4ff9-474b-ae46-d48b28956e63 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:44.737265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:44.737958 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.738245 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.738524 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.739262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:44.740894 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:44.751802 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1375/2791] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:44.756086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.767233 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a16a-6bc8-418a-992e-e8be283f9a7e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:44.771935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ba92b-9c2c-4ffd-8b5c-9c9a5289b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:44.772751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba92b-9c2c-4ffd-8b5c-9c9a5289b640 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.773040 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba92b-9c2c-4ffd-8b5c-9c9a5289b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.773325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ba92b-9c2c-4ffd-8b5c-9c9a5289b640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.774120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba92b-9c2c-4ffd-8b5c-9c9a5289b640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:44.775700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ba92b-9c2c-4ffd-8b5c-9c9a5289b640 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:44.788043 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1417/2792] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:19:44.791668 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.802840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190c2a6-8e41-4a5c-b86c-7d46f3f1c650 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:44.807685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:44.808572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.808856 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.809186 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] PATH_INFO: `/v3/projects/c6c0c2ed43204f3b9dc60a584dbccc00/users/c8fdfbe132ee459cb7541b43cfe6e553/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.824484 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c0c2ed43204f3b9dc60a584dbccc00, user_id=c8fdfbe132ee459cb7541b43cfe6e553, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:44.828218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:44.852529 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1376/2793] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:44 2022] PUT /identity/v3/projects/c6c0c2ed43204f3b9dc60a584dbccc00/users/c8fdfbe132ee459cb7541b43cfe6e553/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:44.854982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:44.855641 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:44.855898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:44.879677 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:44.889070 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] MFA Rules not processed for user `c8fdfbe132ee459cb7541b43cfe6e553`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:44.890927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:44.970084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1418/2794] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:19:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:44.982324 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:44.984203 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:45.071590 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebff2a-ff39-4ae3-b858-0ac31851a549 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:45.076257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbcb9f234fd740fbb644d79ef7215f4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:45.076928 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:45.077214 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:45.077530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:45.086272 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:45.087704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:45.097798 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1377/2795] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:54.967693 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=27 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:55.093540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=72,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:55.976235 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:55.977833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:56.058546 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaee3f-ecd4-4df3-aa5c-0601fb1bcb82 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:56.063697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:56.064600 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:56.064883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:56.065161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] PATH_INFO: `/v3/users/b134345a3cd14856b5efbbe284a6f6c2` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:56.066404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b134345a3cd14856b5efbbe284a6f6c2)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:56.068317 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:56.116128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b134345a3cd14856b5efbbe284a6f6c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.123322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b134345a3cd14856b5efbbe284a6f6c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.123933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b134345a3cd14856b5efbbe284a6f6c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.135697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b134345a3cd14856b5efbbe284a6f6c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.136377 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b134345a3cd14856b5efbbe284a6f6c2'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.149621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1419/2796] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:55 2022] DELETE /identity/v3/users/b134345a3cd14856b5efbbe284a6f6c2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:56.339939 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:56.356535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b6c8-6288-423f-8236-0ae868ecf0dd service glance] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:56.419127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:56.420024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:56.420311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:56.420591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] PATH_INFO: `/v3/projects/f9c305703abc4d428334a8e35a875b9a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:56.421876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c305703abc4d428334a8e35a875b9a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:56.424855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:56.476215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c305703abc4d428334a8e35a875b9a', 'request_id': 'req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.482774 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c305703abc4d428334a8e35a875b9a', 'request_id': 'req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.489309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c305703abc4d428334a8e35a875b9a', 'request_id': 'req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.501325 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] The token cache is being invalidate because project f9c305703abc4d428334a8e35a875b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:56.501659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.502328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-577c0c3e-dc37-4c4b-8dc6-17c7630441f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:56.503892 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1378/2797] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:56 2022] DELETE /identity/v3/projects/f9c305703abc4d428334a8e35a875b9a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:06.145461 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:06.498051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:11.028178 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:11.029659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:11.042879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986e760-5c20-491b-a5d1-94665b2ec9e0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:11.099330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:11.100197 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:11.100474 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:11.100746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] PATH_INFO: `/v3/users/c8fdfbe132ee459cb7541b43cfe6e553` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:11.101974 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fdfbe132ee459cb7541b43cfe6e553)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:11.103876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:11.150091 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fdfbe132ee459cb7541b43cfe6e553'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.157264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fdfbe132ee459cb7541b43cfe6e553'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.157899 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fdfbe132ee459cb7541b43cfe6e553'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.169483 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fdfbe132ee459cb7541b43cfe6e553'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.170100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fdfbe132ee459cb7541b43cfe6e553'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.182949 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1420/2798] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:20:11 2022] DELETE /identity/v3/users/c8fdfbe132ee459cb7541b43cfe6e553 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:11.187783 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:11.188180 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:11.188346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:11.206386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:11.207613 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:11.266144 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1379/2799] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:11.275577 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:11.276960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:11.336573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfb569-65a0-4037-bc4b-e7c76a574fc3 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:11.340187 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:11.340826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:11.341101 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:11.341394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:11.350662 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:11.352150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:11.363438 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1421/2800] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:20:11.630803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:11.632284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:11.645896 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61de1fc-6b52-48e4-b435-a5b1828886eb None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:11.650313 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:11.651188 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:11.651472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:11.651754 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] PATH_INFO: `/v3/projects/c6c0c2ed43204f3b9dc60a584dbccc00` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:11.653010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c0c2ed43204f3b9dc60a584dbccc00)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:11.655010 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:11.701422 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c0c2ed43204f3b9dc60a584dbccc00', 'request_id': 'req-e34d5587-392e-4249-81b3-f361fe8b51a8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.709362 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c0c2ed43204f3b9dc60a584dbccc00', 'request_id': 'req-e34d5587-392e-4249-81b3-f361fe8b51a8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.715077 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c0c2ed43204f3b9dc60a584dbccc00', 'request_id': 'req-e34d5587-392e-4249-81b3-f361fe8b51a8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.726157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] The token cache is being invalidate because project c6c0c2ed43204f3b9dc60a584dbccc00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:20:11.726437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.727054 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:11.728579 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1380/2801] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:20:11 2022] DELETE /identity/v3/projects/c6c0c2ed43204f3b9dc60a584dbccc00 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:21.358284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:21.723114 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:32.894521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:32.895933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:32.955222 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647d7e-a4a5-47ca-8008-ce2d7a641078 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:33.003484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:33.004128 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:33.004413 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:33.004692 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:33.007106 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:33.086069 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:33.087523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:33.106127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1422/2802] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:20:42.117412 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:42.118949 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:42.175828 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d5587-392e-4249-81b3-f361fe8b51a8 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:42.179702 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:42.180351 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:42.180638 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:42.180919 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:42.182748 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:42.246527 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:42.247953 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:42.258297 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1381/2803] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:20:43.103515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=81 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:45.530350 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:45.531862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:45.548160 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc73cf-ab01-4de0-a1ea-94adacb6e908 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:45.552838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:45.554480 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:45.554770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:45.555096 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] PATH_INFO: `/v3/users/7d9d976d8d324b53bcc2adc4c6d081e5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:45.556385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9d976d8d324b53bcc2adc4c6d081e5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:45.558449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:45.612874 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9d976d8d324b53bcc2adc4c6d081e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.622186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9d976d8d324b53bcc2adc4c6d081e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.622803 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9d976d8d324b53bcc2adc4c6d081e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.635620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9d976d8d324b53bcc2adc4c6d081e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.636259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-1c8bb3c2-f77a-4a32-a0a7-22ae85fa15b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9d976d8d324b53bcc2adc4c6d081e5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.648595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1423/2804] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:20:45 2022] DELETE /identity/v3/users/7d9d976d8d324b53bcc2adc4c6d081e5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:45.824310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:45.834442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adae25-98e8-4ce9-a842-5bc24d279e65 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:45.895618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:45.896464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:45.896742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:45.897015 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] PATH_INFO: `/v3/projects/d9b4bce57b1c40ebaee6bdcb2ffc619a` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:45.898530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b4bce57b1c40ebaee6bdcb2ffc619a)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:45.900470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:45.948932 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b4bce57b1c40ebaee6bdcb2ffc619a', 'request_id': 'req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.951471 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:45.956478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b4bce57b1c40ebaee6bdcb2ffc619a', 'request_id': 'req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.962815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b4bce57b1c40ebaee6bdcb2ffc619a', 'request_id': 'req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.973808 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] The token cache is being invalidate because project d9b4bce57b1c40ebaee6bdcb2ffc619a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:20:45.974098 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.974725 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-c27b0a55-7bf1-4c7a-9c8b-fa9366ae5722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:45.976910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1382/2805] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:20:45 2022] DELETE /identity/v3/projects/d9b4bce57b1c40ebaee6bdcb2ffc619a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:45.981922 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769106-d1e7-43ca-8220-aa7c9655efa4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:45.982220 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769106-d1e7-43ca-8220-aa7c9655efa4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:45.982617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76769106-d1e7-43ca-8220-aa7c9655efa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.001748 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-76769106-d1e7-43ca-8220-aa7c9655efa4 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:46.002967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-76769106-d1e7-43ca-8220-aa7c9655efa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:46.066048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1424/2806] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:46.074609 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749edb-489b-4f0e-a4c5-d14b668c689d None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.074904 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749edb-489b-4f0e-a4c5-d14b668c689d None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.075303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749edb-489b-4f0e-a4c5-d14b668c689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.094737 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-1b749edb-489b-4f0e-a4c5-d14b668c689d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:46.095955 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-1b749edb-489b-4f0e-a4c5-d14b668c689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:46.104250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1383/2807] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:20:46.108526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769106-d1e7-43ca-8220-aa7c9655efa4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:46.119264 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76769106-d1e7-43ca-8220-aa7c9655efa4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:46.124037 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:46.124685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.124970 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.125244 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.126015 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:20:46.126325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:46.127935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:46.140523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1425/2808] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:20:46.144779 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749edb-489b-4f0e-a4c5-d14b668c689d None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:46.154916 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749edb-489b-4f0e-a4c5-d14b668c689d None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:46.159656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:46.160320 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.160606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.160887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.161632 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:46.163854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:46.189736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1384/2809] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:20:46 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:20:46.193554 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:46.204499 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64242882-197b-4ce9-a5f9-2c9d3c9f6397 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:46.263869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:46.264521 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.264806 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.265084 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.265826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:46.267751 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:46.275186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:46.291042 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1426/2810] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:20:46 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:20:46.295381 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:46.306427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18defa21-d332-45a1-a72b-79196515a077 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:46.311538 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:46.312205 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.312487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.312764 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.314004 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:46.315859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:46.327421 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1385/2811] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:20:46.331545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:46.343601 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f33755-d321-474c-895e-905e464c0595 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:46.348539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfbd62-1f7d-494d-822d-10ce72ecc7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:46.349200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfbd62-1f7d-494d-822d-10ce72ecc7ef admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.349519 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfbd62-1f7d-494d-822d-10ce72ecc7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.349800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfbd62-1f7d-494d-822d-10ce72ecc7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.351119 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfbd62-1f7d-494d-822d-10ce72ecc7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:46.353298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfbd62-1f7d-494d-822d-10ce72ecc7ef admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:46.363642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1427/2812] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:20:46.367805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:46.378173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786048e-412e-4b9d-b98c-1fcad9e84cc2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:46.382863 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:46.383769 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.384051 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.384328 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] PATH_INFO: `/v3/projects/4aa86c9809c741929cabe3677748ca69/users/da070c8811ee4e7f85a27111befb91b8/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.399335 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa86c9809c741929cabe3677748ca69, user_id=da070c8811ee4e7f85a27111befb91b8, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:46.401969 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:46.415368 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1386/2813] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:20:46 2022] PUT /identity/v3/projects/4aa86c9809c741929cabe3677748ca69/users/da070c8811ee4e7f85a27111befb91b8/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:46.420776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca8ca-b6cc-49d4-9849-98d1e8246b92 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.421066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca8ca-b6cc-49d4-9849-98d1e8246b92 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.421362 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aca8ca-b6cc-49d4-9849-98d1e8246b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.439118 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-63aca8ca-b6cc-49d4-9849-98d1e8246b92 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:46.440603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-63aca8ca-b6cc-49d4-9849-98d1e8246b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:46.499599 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1428/2814] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:46.509405 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:46.511256 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:46.568732 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abc8a4-e7e9-45c4-bc9c-7123f445f900 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:46.572487 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:46.573138 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:46.573451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:46.573734 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:46.582803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:46.584235 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:46.594600 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1387/2815] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:20:50.574217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a08114-0688-4c85-84e3-6d703ac130e0 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:50.574760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a08114-0688-4c85-84e3-6d703ac130e0 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:50.574760 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a08114-0688-4c85-84e3-6d703ac130e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:50.603422 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-b9a08114-0688-4c85-84e3-6d703ac130e0 None None] MFA Rules not processed for user `da070c8811ee4e7f85a27111befb91b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:50.604770 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-b9a08114-0688-4c85-84e3-6d703ac130e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:50.673385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1429/2816] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:50.687824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:50.689383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:50.787816 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daef54-c84c-408b-a3ce-3155085962cc service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:50.794396 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:50.795069 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:50.795358 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:50.795708 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:50.805597 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:50.807287 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:50.817650 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1388/2817] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:20:52.191503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b5914-7b42-4d48-91f9-c9b5a52bf217 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:52.192071 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b5914-7b42-4d48-91f9-c9b5a52bf217 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:52.192614 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b5914-7b42-4d48-91f9-c9b5a52bf217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:52.212486 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9c8b5914-7b42-4d48-91f9-c9b5a52bf217 None None] MFA Rules not processed for user `da070c8811ee4e7f85a27111befb91b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:52.213730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9c8b5914-7b42-4d48-91f9-c9b5a52bf217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:52.220698 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1430/2818] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:20:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:52.545876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:52.552191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:52.556555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab4dc6-a0da-4aa4-8cef-348a858edc78 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:52.561644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:52.562507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:52.562978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:52.563685 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:52.565803 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:52.576191 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:52.577667 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:52.586678 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1389/2819] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:21:02.205528 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:02.582065 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:06.018454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b5914-7b42-4d48-91f9-c9b5a52bf217 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:06.032862 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b5914-7b42-4d48-91f9-c9b5a52bf217 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:06.038584 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:06.040041 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:06.040322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:06.040595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:06.042436 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:06.055298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:06.056997 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:06.068924 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1431/2820] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:21:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:21:16.063663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:54.398110 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:54.399515 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:54.470274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3c97e-eebf-4f76-aa72-f053e58c5755 service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:54.475179 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:54.475820 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:54.476100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:54.476378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:54.478133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:54.489603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:54.491158 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:54.501771 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1390/2821] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:21:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:22:04.497518 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=32 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:51.956161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:22:51.965609 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f6aa2-a102-4273-8d4e-5c8426e8d16c service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:22:51.969885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:22:51.970525 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:22:51.970813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:22:51.971092 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:22:51.972879 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:22:51.986977 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:22:51.988394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:22:52.000026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1432/2822] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:22:55.512777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:22:55.523033 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb6442-2acc-4976-a255-6cea90b6fbdb service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:22:55.526639 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:22:55.527283 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:22:55.527568 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:22:55.527849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:22:55.529654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:22:55.543733 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:22:55.545155 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:22:55.556293 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1391/2823] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:01.994574 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:05.551308 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=6 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:50.080385 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:50.081885 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:50.092651 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c854ff-03ef-4a33-ba35-c7363ed523c5 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:50.096644 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a348ae-faf4-4525-b346-4842f08469e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:50.097288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a348ae-faf4-4525-b346-4842f08469e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:50.097594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a348ae-faf4-4525-b346-4842f08469e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:50.097865 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a348ae-faf4-4525-b346-4842f08469e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:50.099733 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e7a348ae-faf4-4525-b346-4842f08469e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:50.109778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a348ae-faf4-4525-b346-4842f08469e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:50.111912 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a348ae-faf4-4525-b346-4842f08469e2 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:50.120038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1433/2824] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:00.116337 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=6 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:38.592743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:38.610159 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fe034-b660-4518-9919-2e7a94de7e6a service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:38.616767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:38.617468 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:38.617755 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:38.618286 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:38.620076 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:38.633729 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:38.635545 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:38.647696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1392/2825] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:25:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:25:42.039121 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355f5ab-48be-48aa-9b5c-b3dc7b5e2e20 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.039628 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355f5ab-48be-48aa-9b5c-b3dc7b5e2e20 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.039762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355f5ab-48be-48aa-9b5c-b3dc7b5e2e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.058709 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-9355f5ab-48be-48aa-9b5c-b3dc7b5e2e20 None None] MFA Rules not processed for user `da070c8811ee4e7f85a27111befb91b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:25:42.059908 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-9355f5ab-48be-48aa-9b5c-b3dc7b5e2e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:42.066800 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1434/2826] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:25:42.936555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:42.938156 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:42.952577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59016222-0267-4bd0-9353-60bd2fb6953d service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:42.958175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:42.958837 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.959127 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.959409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.961289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:42.974776 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:42.976387 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:42.989018 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1393/2827] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:25:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:25:50.935217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355f5ab-48be-48aa-9b5c-b3dc7b5e2e20 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:50.949449 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355f5ab-48be-48aa-9b5c-b3dc7b5e2e20 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:50.955224 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:50.955864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:50.956149 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:50.956427 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:50.964933 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:50.966549 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:50.976126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1435/2828] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:25:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:25:51.538470 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:51.540019 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:51.559202 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c81565-d3f2-437f-95d0-0dcb51310512 service placement] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:51.569682 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:51.570366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:51.570656 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:51.570937 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:51.572829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:51.586379 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:51.587977 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:51.599294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1394/2829] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:25:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:26:00.972141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=9 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:01.595237 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=18 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:57.416394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:57.475646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46db2dc-099e-4d3e-9a8e-ae1f0d15fc7d service nova] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:57.480685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:57.481319 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:57.481742 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:57.482020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:57.491762 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:57.493623 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:57.505496 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1436/2830] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:26:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:07.501050 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=27 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:46.173451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.210728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee00fe5-cc0d-40cc-bcab-b58f7aab5458 service nova] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.214439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.215085 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.215370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.215653 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.227380 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.228805 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.259049 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1395/2831] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:49.346971 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.364336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37817015-4d0b-49b1-9eed-cc593e2f0774 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.380133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.381256 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.381774 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.382265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.385722 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:49.424087 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.443554 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d29b7-9394-4984-8f56-91b634f8cfcc service neutron] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.449147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.450464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.450651 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.450912 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] PATH_INFO: `/v3/users/da070c8811ee4e7f85a27111befb91b8` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.452975 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da070c8811ee4e7f85a27111befb91b8)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.457133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.461782 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.463460 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.475910 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1437/2832] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:49.524577 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da070c8811ee4e7f85a27111befb91b8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.533504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da070c8811ee4e7f85a27111befb91b8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.534200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da070c8811ee4e7f85a27111befb91b8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.534887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da070c8811ee4e7f85a27111befb91b8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.542221 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-4766f8e5-a7b1-4554-8a7a-58c8a5e3c501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da070c8811ee4e7f85a27111befb91b8'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.564971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1396/2833] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:49 2022] DELETE /identity/v3/users/da070c8811ee4e7f85a27111befb91b8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:49.767028 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.777780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641496-fa1f-4723-b398-41757b9e1b51 service placement] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.837852 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.838700 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.838979 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.839250 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] PATH_INFO: `/v3/projects/4aa86c9809c741929cabe3677748ca69` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.840414 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa86c9809c741929cabe3677748ca69)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.842365 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.888363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa86c9809c741929cabe3677748ca69', 'request_id': 'req-4893fef5-b723-475c-84a0-ef7f2c3c09fa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.894225 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa86c9809c741929cabe3677748ca69', 'request_id': 'req-4893fef5-b723-475c-84a0-ef7f2c3c09fa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.901254 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa86c9809c741929cabe3677748ca69', 'request_id': 'req-4893fef5-b723-475c-84a0-ef7f2c3c09fa'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.925808 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] The token cache is being invalidate because project 4aa86c9809c741929cabe3677748ca69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:49.926093 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.926720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4893fef5-b723-475c-84a0-ef7f2c3c09fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:49.928255 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1438/2834] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:49 2022] DELETE /identity/v3/projects/4aa86c9809c741929cabe3677748ca69 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:49.933397 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e73702-d97c-44a0-9f36-915dc29ffe9c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.933711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e73702-d97c-44a0-9f36-915dc29ffe9c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.933999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e73702-d97c-44a0-9f36-915dc29ffe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.990349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c0e73702-d97c-44a0-9f36-915dc29ffe9c None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:49.991563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c0e73702-d97c-44a0-9f36-915dc29ffe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:50.037827 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:50.057481 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1397/2835] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:50.065275 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7ac8b-d437-459b-b58f-f5a6c6dc63e3 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.065595 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7ac8b-d437-459b-b58f-f5a6c6dc63e3 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.065880 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7ac8b-d437-459b-b58f-f5a6c6dc63e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.084265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-10e7ac8b-d437-459b-b58f-f5a6c6dc63e3 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:50.085515 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-10e7ac8b-d437-459b-b58f-f5a6c6dc63e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:50.094226 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1439/2836] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:50.098388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e73702-d97c-44a0-9f36-915dc29ffe9c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.108120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e73702-d97c-44a0-9f36-915dc29ffe9c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.113201 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.113891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.114172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.114442 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.115162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:50.115466 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.117048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.128654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1398/2837] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:50.132689 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7ac8b-d437-459b-b58f-f5a6c6dc63e3 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.142657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7ac8b-d437-459b-b58f-f5a6c6dc63e3 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.147320 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.147966 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.148249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.148523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.149211 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.151139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.177741 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1440/2838] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:50 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:50.181785 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.192760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801af5d3-c1e7-4f80-a786-c2567a611ec7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.252564 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.253231 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.253542 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.253819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.254514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.256458 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.275572 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1399/2839] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:50 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:50.279730 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.291186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192880f5-1f4a-4844-a74e-d3be1d02d838 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.295881 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.296673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.296960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.297243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.298009 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.299618 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.310089 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1441/2840] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:50.313971 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.324274 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b01de1-8027-4f6d-8346-2844c1035c3d admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.329777 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc50e-23d5-434d-8a17-c53dda0dbe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.330437 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc50e-23d5-434d-8a17-c53dda0dbe3f admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.330723 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc50e-23d5-434d-8a17-c53dda0dbe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.330999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc50e-23d5-434d-8a17-c53dda0dbe3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.331731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc50e-23d5-434d-8a17-c53dda0dbe3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.333318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc50e-23d5-434d-8a17-c53dda0dbe3f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.344031 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1400/2841] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:50.348083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.358269 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb389cc-7acf-48f5-a71e-9b954686518c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.363598 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.364472 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.364754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.365031 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] PATH_INFO: `/v3/projects/78c3ec990ac4465f902a64a865130ce8/users/8d9dd2c5f8b24a68bfffffcb371c45e6/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.367388 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:50.382072 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c3ec990ac4465f902a64a865130ce8, user_id=8d9dd2c5f8b24a68bfffffcb371c45e6, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.384750 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.397632 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1442/2842] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:50 2022] PUT /identity/v3/projects/78c3ec990ac4465f902a64a865130ce8/users/8d9dd2c5f8b24a68bfffffcb371c45e6/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:50.409464 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.409758 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.410036 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.435872 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] MFA Rules not processed for user `8d9dd2c5f8b24a68bfffffcb371c45e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:50.437255 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:50.503473 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1401/2843] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:27:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:50.514126 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.516611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:50.596864 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26397-1479-4bed-9c35-4012001d7a6a admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.600541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.601190 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.601505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.601783 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.611018 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.612445 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.621328 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1443/2844] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:53.363573 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.365075 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.377150 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8b49-99bb-4718-96a1-b85b28b2d72e None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.380745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.381456 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.381741 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.382020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.383743 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.427142 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:53.477842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.479349 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.500279 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1402/2845] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:54.893504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.905505 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfd7d8-52d2-44ea-92aa-767193c363ec service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.909200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91973f0-eb48-4be6-a71c-be83cfbdfafa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.909875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91973f0-eb48-4be6-a71c-be83cfbdfafa service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.910157 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91973f0-eb48-4be6-a71c-be83cfbdfafa service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.910429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91973f0-eb48-4be6-a71c-be83cfbdfafa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.912246 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e91973f0-eb48-4be6-a71c-be83cfbdfafa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.926884 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91973f0-eb48-4be6-a71c-be83cfbdfafa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.928349 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91973f0-eb48-4be6-a71c-be83cfbdfafa service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.941606 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1444/2846] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:59.142694 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:59.204840 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4aad7-ae75-4577-a9ac-470dd40370a3 service cinder] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:59.209398 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:59.210268 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:59.210543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:59.210814 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] PATH_INFO: `/v3/users/8d9dd2c5f8b24a68bfffffcb371c45e6` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:59.211982 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9dd2c5f8b24a68bfffffcb371c45e6)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:59.213920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:59.261432 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9dd2c5f8b24a68bfffffcb371c45e6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.272230 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9dd2c5f8b24a68bfffffcb371c45e6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.272859 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9dd2c5f8b24a68bfffffcb371c45e6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.273627 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9dd2c5f8b24a68bfffffcb371c45e6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.282644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9dd2c5f8b24a68bfffffcb371c45e6'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.301083 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1403/2847] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:59 2022] DELETE /identity/v3/users/8d9dd2c5f8b24a68bfffffcb371c45e6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:59.310633 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:59.312842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:59.313170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:59.339485 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:59.340743 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:59.425026 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1445/2848] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:59.435024 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:59.436311 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:59.460624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:59.518011 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282a1d4-624d-48aa-9af3-8243770546c0 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:59.521818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef73c70-a189-4f13-a979-81b6a9382e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:59.522593 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73c70-a189-4f13-a979-81b6a9382e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:59.522884 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73c70-a189-4f13-a979-81b6a9382e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:59.523157 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef73c70-a189-4f13-a979-81b6a9382e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:59.532693 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef73c70-a189-4f13-a979-81b6a9382e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:59.534974 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef73c70-a189-4f13-a979-81b6a9382e05 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:59.545377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1404/2849] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:59.824055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:59.826127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:59.839776 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff2111-f2c7-4aae-914f-0e0d112dfdd6 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:59.844685 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:59.846523 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:59.846810 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:59.847086 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] PATH_INFO: `/v3/projects/78c3ec990ac4465f902a64a865130ce8` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:59.848383 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c3ec990ac4465f902a64a865130ce8)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:59.850193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:59.896939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:59.898736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c3ec990ac4465f902a64a865130ce8', 'request_id': 'req-ea890141-dfb6-4388-83d5-05eba8fa2780'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.905883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c3ec990ac4465f902a64a865130ce8', 'request_id': 'req-ea890141-dfb6-4388-83d5-05eba8fa2780'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.913387 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c3ec990ac4465f902a64a865130ce8', 'request_id': 'req-ea890141-dfb6-4388-83d5-05eba8fa2780'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.925210 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] The token cache is being invalidate because project 78c3ec990ac4465f902a64a865130ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:59.925553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.926174 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-ea890141-dfb6-4388-83d5-05eba8fa2780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:59.927813 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1446/2850] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:59 2022] DELETE /identity/v3/projects/78c3ec990ac4465f902a64a865130ce8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:59.932781 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8506191-7591-4cd0-82b4-9f7c89466b44 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:59.933108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8506191-7591-4cd0-82b4-9f7c89466b44 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:59.933514 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8506191-7591-4cd0-82b4-9f7c89466b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:59.952537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-c8506191-7591-4cd0-82b4-9f7c89466b44 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:59.953876 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-c8506191-7591-4cd0-82b4-9f7c89466b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:00.014079 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1405/2851] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:28:00.022976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53b072-d585-4b2f-ab23-200b840228d2 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.023270 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53b072-d585-4b2f-ab23-200b840228d2 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.023553 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53b072-d585-4b2f-ab23-200b840228d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.041629 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-3e53b072-d585-4b2f-ab23-200b840228d2 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:00.042842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3e53b072-d585-4b2f-ab23-200b840228d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:00.051487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1447/2852] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:00.055535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8506191-7591-4cd0-82b4-9f7c89466b44 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.065786 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8506191-7591-4cd0-82b4-9f7c89466b44 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.070319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.070968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.071249 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.071525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.072244 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:00.072549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.074181 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.087603 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1406/2853] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:28:00.092209 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53b072-d585-4b2f-ab23-200b840228d2 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.101243 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53b072-d585-4b2f-ab23-200b840228d2 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.105984 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.106630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.106913 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.107188 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.107872 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.110395 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.137397 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1448/2854] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:00 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:00.141558 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.151549 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a591122-ec16-41ec-b0ef-f4c5ea9c3385 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.207172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.207760 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.208041 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.208318 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.209001 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.210950 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.230659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1407/2855] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:00 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:00.235833 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.246396 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69036-2103-4a9e-8a88-7594aa4da526 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.251951 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.252637 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.252926 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.253200 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.253965 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.255608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.266503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1449/2856] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:00.270731 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.281376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc53e-26d2-4ffd-ba36-7aa264307ba2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.285990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278869a-0ee2-4650-be96-6ffefaab36fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.286644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278869a-0ee2-4650-be96-6ffefaab36fe admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.286925 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278869a-0ee2-4650-be96-6ffefaab36fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.287200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278869a-0ee2-4650-be96-6ffefaab36fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.287923 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278869a-0ee2-4650-be96-6ffefaab36fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.289561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278869a-0ee2-4650-be96-6ffefaab36fe admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.301866 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1408/2857] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:00.305897 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.317674 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb668c-7744-44ba-b81f-e7768cb8c0eb admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.322203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.323083 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.323367 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.323642 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] PATH_INFO: `/v3/projects/71b65c3a8c83432e8964d6e8f0ef4c8b/users/734027c6237f4df8a9b1b65fca3bda59/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.339253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b65c3a8c83432e8964d6e8f0ef4c8b, user_id=734027c6237f4df8a9b1b65fca3bda59, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.341959 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.355716 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1450/2858] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:00 2022] PUT /identity/v3/projects/71b65c3a8c83432e8964d6e8f0ef4c8b/users/734027c6237f4df8a9b1b65fca3bda59/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:00.366409 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef2b1-7d81-4448-8fcc-fac567539f2c None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.366704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef2b1-7d81-4448-8fcc-fac567539f2c None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.366985 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ef2b1-7d81-4448-8fcc-fac567539f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.395172 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-ca8ef2b1-7d81-4448-8fcc-fac567539f2c None None] MFA Rules not processed for user `734027c6237f4df8a9b1b65fca3bda59`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:00.396457 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-ca8ef2b1-7d81-4448-8fcc-fac567539f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:00.402190 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:00.464236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1409/2859] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:00.478736 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.480792 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:00.556407 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d292b6-b423-419e-b4d6-8dadec5dab13 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.562451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57335e-99b0-4d89-8e9b-c8e77befdbd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85186f8437164bbbb99e007b5c85bd54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.563100 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57335e-99b0-4d89-8e9b-c8e77befdbd8 service nova] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.563389 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57335e-99b0-4d89-8e9b-c8e77befdbd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.563667 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57335e-99b0-4d89-8e9b-c8e77befdbd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.571446 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57335e-99b0-4d89-8e9b-c8e77befdbd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.573012 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57335e-99b0-4d89-8e9b-c8e77befdbd8 service nova] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.582450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1451/2860] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:00.798119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ef2b1-7d81-4448-8fcc-fac567539f2c None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.860443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ef2b1-7d81-4448-8fcc-fac567539f2c None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.864941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.865842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.866129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.866407 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] PATH_INFO: `/v3/users/734027c6237f4df8a9b1b65fca3bda59` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.867616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=734027c6237f4df8a9b1b65fca3bda59)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.869594 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.917503 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734027c6237f4df8a9b1b65fca3bda59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.924493 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734027c6237f4df8a9b1b65fca3bda59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.925108 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734027c6237f4df8a9b1b65fca3bda59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.925735 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734027c6237f4df8a9b1b65fca3bda59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.932535 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734027c6237f4df8a9b1b65fca3bda59'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.949757 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1410/2861] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:00 2022] DELETE /identity/v3/users/734027c6237f4df8a9b1b65fca3bda59 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:00.955016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.955308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.955588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.973900 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:00.975046 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:01.025279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:01.035703 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1452/2862] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:01.046034 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.047610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:01.081567 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:01.111284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40ebbd-e5ee-4bcc-908f-84f9fdf3e56f admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.114948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae922db-55af-41c1-849a-d500aec5c9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.115598 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae922db-55af-41c1-849a-d500aec5c9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.115883 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae922db-55af-41c1-849a-d500aec5c9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.116162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae922db-55af-41c1-849a-d500aec5c9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.125834 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae922db-55af-41c1-849a-d500aec5c9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.127266 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae922db-55af-41c1-849a-d500aec5c9f8 service neutron] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.136711 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1411/2863] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:01.430655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.432120 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:01.446124 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646bf1a2-3550-4365-9957-7cd4d5bd9b34 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.451212 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.452184 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.452465 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.452740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] PATH_INFO: `/v3/projects/71b65c3a8c83432e8964d6e8f0ef4c8b` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.454004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b65c3a8c83432e8964d6e8f0ef4c8b)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.455990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.505887 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b65c3a8c83432e8964d6e8f0ef4c8b', 'request_id': 'req-c11fe210-6b56-44d1-ae0b-aa1b4d525972'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.512076 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b65c3a8c83432e8964d6e8f0ef4c8b', 'request_id': 'req-c11fe210-6b56-44d1-ae0b-aa1b4d525972'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.519841 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b65c3a8c83432e8964d6e8f0ef4c8b', 'request_id': 'req-c11fe210-6b56-44d1-ae0b-aa1b4d525972'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.531821 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] The token cache is being invalidate because project 71b65c3a8c83432e8964d6e8f0ef4c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80134) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:01.532108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.532740 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-c11fe210-6b56-44d1-ae0b-aa1b4d525972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.534322 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1453/2864] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:01 2022] DELETE /identity/v3/projects/71b65c3a8c83432e8964d6e8f0ef4c8b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:01.539233 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583d4b-0404-4461-bcb0-f2495a80b250 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.539721 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583d4b-0404-4461-bcb0-f2495a80b250 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.539825 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93583d4b-0404-4461-bcb0-f2495a80b250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.557415 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-93583d4b-0404-4461-bcb0-f2495a80b250 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:01.558615 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-93583d4b-0404-4461-bcb0-f2495a80b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:01.617124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1412/2865] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:01.625883 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4126f-627f-4423-9501-39a51f1a3dac None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.626173 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4126f-627f-4423-9501-39a51f1a3dac None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.626454 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4126f-627f-4423-9501-39a51f1a3dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.648057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-98c4126f-627f-4423-9501-39a51f1a3dac None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:01.649604 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-98c4126f-627f-4423-9501-39a51f1a3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:01.660435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1454/2866] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:01.664636 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93583d4b-0404-4461-bcb0-f2495a80b250 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.675184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93583d4b-0404-4461-bcb0-f2495a80b250 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.679697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.680346 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.680626 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.680898 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.681767 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80135) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:01.682068 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.683688 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.695612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1413/2867] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:28:01.700044 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4126f-627f-4423-9501-39a51f1a3dac None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.709576 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4126f-627f-4423-9501-39a51f1a3dac None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.714283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.714935 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.715218 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.715495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.716180 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.718341 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.750179 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1455/2868] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:01 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:01.754611 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.764948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c4e5a-93c6-45de-ae5d-6faae0dc3ce7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.822857 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.823561 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.823846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.824124 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.825612 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.828461 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.852526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1414/2869] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:01 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:01.856668 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.867704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312cdfc-c11c-42c6-aba3-e0eeeae88856 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.872265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.872927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.873213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.873530 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.874759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.876352 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.888336 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1456/2870] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:01.893216 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.903768 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ce7a2-ba9e-4469-b0de-3a98c4573167 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.908736 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7b5be-841d-47d2-b2f6-c13f795cd792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.909424 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7b5be-841d-47d2-b2f6-c13f795cd792 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.909709 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7b5be-841d-47d2-b2f6-c13f795cd792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.909986 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7b5be-841d-47d2-b2f6-c13f795cd792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.910782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7b5be-841d-47d2-b2f6-c13f795cd792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.912509 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7b5be-841d-47d2-b2f6-c13f795cd792 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.924037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1415/2871] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:01.928518 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.942139 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15b4c-cf82-4e3b-a82f-ee00122a93b0 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.946758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.947781 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.948062 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.948467 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] PATH_INFO: `/v3/projects/03c26b44ec80423296f9979012a5416b/users/54fcd90373d54be8a3a442ec4150931a/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.964758 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c26b44ec80423296f9979012a5416b, user_id=54fcd90373d54be8a3a442ec4150931a, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.967455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.986283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1457/2872] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:01 2022] PUT /identity/v3/projects/03c26b44ec80423296f9979012a5416b/users/54fcd90373d54be8a3a442ec4150931a/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:02.052887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532bdb-ae6d-40dd-9860-21092d3f8796 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.053175 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532bdb-ae6d-40dd-9860-21092d3f8796 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.053477 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532bdb-ae6d-40dd-9860-21092d3f8796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.081366 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a2532bdb-ae6d-40dd-9860-21092d3f8796 None None] MFA Rules not processed for user `54fcd90373d54be8a3a442ec4150931a`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:02.082610 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2532bdb-ae6d-40dd-9860-21092d3f8796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:02.106829 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:02.150352 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1416/2873] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:02.155649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.221141 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bb44c-5058-4186-ab2d-06dd32466500 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.225847 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.226630 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.226915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.227191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.227998 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.230004 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.257960 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1458/2874] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:02 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:02.262163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532bdb-ae6d-40dd-9860-21092d3f8796 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.273129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2532bdb-ae6d-40dd-9860-21092d3f8796 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.331281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.333654 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.333992 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.334281 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.335494 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.338565 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.365614 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1417/2875] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:02 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:02.371170 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.380151 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:02.388333 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5f3df-89a9-4926-871e-ce34556c1bea admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.395867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.396545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.396829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.397107 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.397875 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.399504 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.410477 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1459/2876] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:02.414628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.425309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a24ea-6448-4491-878f-0977f38558a6 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.429920 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.430818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.431096 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.431369 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] PATH_INFO: `/v3/projects/a2183b12dce346a9b381715f6c04504f/users/625096dbeaad4bff8ef43c624fcad7eb/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.446691 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2183b12dce346a9b381715f6c04504f, user_id=625096dbeaad4bff8ef43c624fcad7eb, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.449659 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.462474 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1418/2877] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:02 2022] PUT /identity/v3/projects/a2183b12dce346a9b381715f6c04504f/users/625096dbeaad4bff8ef43c624fcad7eb/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:28:02.466279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.476475 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bded708-532a-469f-a2f4-819572132b56 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.536492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb99de-f99a-4c93-8fa9-00404b6bf454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.537138 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb99de-f99a-4c93-8fa9-00404b6bf454 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.537569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb99de-f99a-4c93-8fa9-00404b6bf454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.537869 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb99de-f99a-4c93-8fa9-00404b6bf454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.538573 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb99de-f99a-4c93-8fa9-00404b6bf454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.540163 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb99de-f99a-4c93-8fa9-00404b6bf454 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.550360 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1460/2878] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:02.554508 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.565289 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa230d5-013b-49a3-a443-5549988ab867 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.569941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.570821 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.571113 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.571392 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] PATH_INFO: `/v3/projects/a2183b12dce346a9b381715f6c04504f/users/625096dbeaad4bff8ef43c624fcad7eb/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.573441 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2183b12dce346a9b381715f6c04504f, user_id=625096dbeaad4bff8ef43c624fcad7eb, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.576350 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.586738 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1419/2879] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:02 2022] PUT /identity/v3/projects/a2183b12dce346a9b381715f6c04504f/users/625096dbeaad4bff8ef43c624fcad7eb/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:02.597105 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1ce7c-fdab-43b0-8501-14c89c8066e4 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.597429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1ce7c-fdab-43b0-8501-14c89c8066e4 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.597710 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1ce7c-fdab-43b0-8501-14c89c8066e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.623643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-43a1ce7c-fdab-43b0-8501-14c89c8066e4 None None] MFA Rules not processed for user `625096dbeaad4bff8ef43c624fcad7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:02.624923 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-43a1ce7c-fdab-43b0-8501-14c89c8066e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:02.691939 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1461/2880] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:02.703433 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.705200 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:02.763502 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17db4-e42c-4962-9490-36810c4c3da7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.767472 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bedc5-a03e-4598-877d-11cbc06af107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.768120 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bedc5-a03e-4598-877d-11cbc06af107 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.768406 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bedc5-a03e-4598-877d-11cbc06af107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.768681 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bedc5-a03e-4598-877d-11cbc06af107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.777730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bedc5-a03e-4598-877d-11cbc06af107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.779162 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bedc5-a03e-4598-877d-11cbc06af107 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.789213 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1420/2881] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:02.817296 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1ce7c-fdab-43b0-8501-14c89c8066e4 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.879636 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1ce7c-fdab-43b0-8501-14c89c8066e4 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.884204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.885055 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.885335 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.885673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] PATH_INFO: `/v3/users/54fcd90373d54be8a3a442ec4150931a` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.886867 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54fcd90373d54be8a3a442ec4150931a)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.888766 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.903154 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:02.936489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54fcd90373d54be8a3a442ec4150931a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.950854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54fcd90373d54be8a3a442ec4150931a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.951492 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54fcd90373d54be8a3a442ec4150931a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.964375 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54fcd90373d54be8a3a442ec4150931a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.965025 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54fcd90373d54be8a3a442ec4150931a'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.979399 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1462/2882] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:02 2022] DELETE /identity/v3/users/54fcd90373d54be8a3a442ec4150931a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:02.983749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.984048 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.984344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.001596 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:03.002818 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:03.015539 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:03.061699 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1421/2883] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:28:03.071746 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.073150 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:03.138983 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faa19e-3b1c-4aa8-87fd-79a5258ba47f admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.143057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.143697 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.143976 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.144249 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.153228 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.154679 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.164611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1463/2884] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:03.454878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.456310 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:03.471411 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c19ca-5f70-4de5-ac73-8780ea90fe89 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.477941 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.478819 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.479101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.479425 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] PATH_INFO: `/v3/projects/03c26b44ec80423296f9979012a5416b` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.480640 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c26b44ec80423296f9979012a5416b)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.483153 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.536784 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c26b44ec80423296f9979012a5416b', 'request_id': 'req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.545021 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c26b44ec80423296f9979012a5416b', 'request_id': 'req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.551250 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c26b44ec80423296f9979012a5416b', 'request_id': 'req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.562782 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] The token cache is being invalidate because project 03c26b44ec80423296f9979012a5416b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:03.563408 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.563845 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.565674 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1422/2885] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:03 2022] DELETE /identity/v3/projects/03c26b44ec80423296f9979012a5416b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:03.569688 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.580426 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebeac6-bcf2-4631-a4d1-2374768afab4 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.636845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.638021 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.638295 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.638569 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] PATH_INFO: `/v3/users/625096dbeaad4bff8ef43c624fcad7eb` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.639778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=625096dbeaad4bff8ef43c624fcad7eb)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.641720 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.678527 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:03.690161 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '625096dbeaad4bff8ef43c624fcad7eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.697754 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '625096dbeaad4bff8ef43c624fcad7eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.698401 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '625096dbeaad4bff8ef43c624fcad7eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.710540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '625096dbeaad4bff8ef43c624fcad7eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.711288 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-024a3152-6409-4361-a4ce-45925d5cf16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '625096dbeaad4bff8ef43c624fcad7eb'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.723564 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1464/2886] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:03 2022] DELETE /identity/v3/users/625096dbeaad4bff8ef43c624fcad7eb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:28:03.997696 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.999842 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:04.013165 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203f26b-5ee1-42a0-973f-3b6f915fbfb7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.071007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.071878 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.072160 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.072434 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] PATH_INFO: `/v3/projects/a2183b12dce346a9b381715f6c04504f` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.073751 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2183b12dce346a9b381715f6c04504f)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.075973 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.119476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:04.122663 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2183b12dce346a9b381715f6c04504f', 'request_id': 'req-fde0215e-34fd-47fc-833a-4b0e5d22d30c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:04.129938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2183b12dce346a9b381715f6c04504f', 'request_id': 'req-fde0215e-34fd-47fc-833a-4b0e5d22d30c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:04.135451 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2183b12dce346a9b381715f6c04504f', 'request_id': 'req-fde0215e-34fd-47fc-833a-4b0e5d22d30c'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:04.146530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] The token cache is being invalidate because project a2183b12dce346a9b381715f6c04504f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:04.146811 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:04.147430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-fde0215e-34fd-47fc-833a-4b0e5d22d30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:04.148970 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1423/2887] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:03 2022] DELETE /identity/v3/projects/a2183b12dce346a9b381715f6c04504f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:04.154020 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0421-d699-4e0c-9e8b-ef3e29ee19d7 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.154312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0421-d699-4e0c-9e8b-ef3e29ee19d7 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.154594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b0421-d699-4e0c-9e8b-ef3e29ee19d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.174891 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-1e5b0421-d699-4e0c-9e8b-ef3e29ee19d7 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:04.176102 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1e5b0421-d699-4e0c-9e8b-ef3e29ee19d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:04.234540 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1465/2888] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:04.242395 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de22227-aedd-4a04-bfeb-510b69fe2358 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.242687 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de22227-aedd-4a04-bfeb-510b69fe2358 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.242967 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de22227-aedd-4a04-bfeb-510b69fe2358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.261126 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-8de22227-aedd-4a04-bfeb-510b69fe2358 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:04.262373 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-8de22227-aedd-4a04-bfeb-510b69fe2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:04.270430 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1424/2889] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:04.274611 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0421-d699-4e0c-9e8b-ef3e29ee19d7 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.285158 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b0421-d699-4e0c-9e8b-ef3e29ee19d7 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.289790 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.290442 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.290724 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.291000 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.291725 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:04.292029 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.293643 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.305757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1466/2890] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:28:04.310052 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de22227-aedd-4a04-bfeb-510b69fe2358 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.319299 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de22227-aedd-4a04-bfeb-510b69fe2358 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.323940 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.324849 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.325129 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.325435 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.326119 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.328116 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.353215 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1425/2891] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:04.357321 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.370400 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b771a-6d66-4f64-b465-9ada504820db admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.428594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.429265 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.429580 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.429863 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.430558 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.432495 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.455930 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1467/2892] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:04.460258 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.471187 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b356f8-0f1d-416b-b784-b4d176e1cddc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.475726 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.476391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.476669 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.476948 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.477704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.479303 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.491168 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1426/2893] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:28:04.495363 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.508621 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9fe49-52c9-4c3a-a39d-e83f514c1936 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.513659 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6059-6794-4265-8bf2-88bee6f74608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.514727 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6059-6794-4265-8bf2-88bee6f74608 admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.515236 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6059-6794-4265-8bf2-88bee6f74608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.515581 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6059-6794-4265-8bf2-88bee6f74608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.516526 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6059-6794-4265-8bf2-88bee6f74608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.518555 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6059-6794-4265-8bf2-88bee6f74608 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.533186 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1468/2894] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:04.537391 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.548854 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89523b1a-5612-48a6-8c96-3b2edc3a2874 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.553526 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.554399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.554679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.554952 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] PATH_INFO: `/v3/projects/c30f458a703c4d2b9fbcab4f296cf4b7/users/4894a53c331f49e3a2391c707135c3c5/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.569976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30f458a703c4d2b9fbcab4f296cf4b7, user_id=4894a53c331f49e3a2391c707135c3c5, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.572616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.586850 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1427/2895] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:04 2022] PUT /identity/v3/projects/c30f458a703c4d2b9fbcab4f296cf4b7/users/4894a53c331f49e3a2391c707135c3c5/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:28:04.598404 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdea9bf-517d-4252-af20-4a8d549bef76 None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.598955 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdea9bf-517d-4252-af20-4a8d549bef76 None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.599061 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdea9bf-517d-4252-af20-4a8d549bef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.625946 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-acdea9bf-517d-4252-af20-4a8d549bef76 None None] MFA Rules not processed for user `4894a53c331f49e3a2391c707135c3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:04.627162 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-acdea9bf-517d-4252-af20-4a8d549bef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:04.635429 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:04.698829 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1469/2896] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:04.704285 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.769666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1c3d9-851b-48b6-91c3-3c609b3d0b87 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.774322 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.774976 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.775378 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.775604 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.776301 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.778223 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.810664 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1428/2897] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:04.816006 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdea9bf-517d-4252-af20-4a8d549bef76 None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.832204 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdea9bf-517d-4252-af20-4a8d549bef76 None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.900789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.901503 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.901789 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.902066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.902759 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.904666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.924116 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1470/2898] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:28:04.928260 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.939309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f9fe1-295d-4e91-b12a-a85bb4d5af18 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.943889 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.944543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.944824 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.945141 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.945908 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.947504 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.958855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1429/2899] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:04.963060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.973369 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a25ba2-94f7-4b9f-b0fc-4d3b22ec2410 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.978508 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.979529 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.979854 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.980193 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] PATH_INFO: `/v3/projects/5b6ae1e44a314f6a9249984ed9674e02/users/ce3994de4e7347a7b86a6b1b2af81f8c/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.994967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6ae1e44a314f6a9249984ed9674e02, user_id=ce3994de4e7347a7b86a6b1b2af81f8c, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.997655 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:05.011142 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1471/2900] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:04 2022] PUT /identity/v3/projects/5b6ae1e44a314f6a9249984ed9674e02/users/ce3994de4e7347a7b86a6b1b2af81f8c/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:05.015999 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:05.026032 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1ad9-4ef5-486c-92e7-eec6cbb7dce2 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:05.067376 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:05.084121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9efd5-5f8f-4d2a-af68-62020b67437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:05.084794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9efd5-5f8f-4d2a-af68-62020b67437b admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:05.085073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9efd5-5f8f-4d2a-af68-62020b67437b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:05.085370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9efd5-5f8f-4d2a-af68-62020b67437b admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:05.086107 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9efd5-5f8f-4d2a-af68-62020b67437b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:05.087717 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9efd5-5f8f-4d2a-af68-62020b67437b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:05.098460 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1430/2901] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:05.102522 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:05.114230 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075608f-36be-423b-9fe6-35858756a78c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:05.118905 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:05.119901 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:05.120182 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:05.120455 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] PATH_INFO: `/v3/projects/5b6ae1e44a314f6a9249984ed9674e02/users/ce3994de4e7347a7b86a6b1b2af81f8c/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:05.122541 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6ae1e44a314f6a9249984ed9674e02, user_id=ce3994de4e7347a7b86a6b1b2af81f8c, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:05.125191 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:05.135484 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1472/2902] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:05 2022] PUT /identity/v3/projects/5b6ae1e44a314f6a9249984ed9674e02/users/ce3994de4e7347a7b86a6b1b2af81f8c/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:05.146810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:05.147100 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:05.147370 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:05.180753 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] MFA Rules not processed for user `ce3994de4e7347a7b86a6b1b2af81f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:05.182089 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:05.252869 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1431/2903] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:05.264075 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:05.266582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:05.322785 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e7a11-35e4-4460-b235-50897eeb3f7e admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:05.326520 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:05.327657 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:05.327929 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:05.328203 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:05.340620 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:05.384545 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:05.386016 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:05.395755 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1473/2904] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:06.744154 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:06.745599 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:06.757740 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918513e-1e1f-4b08-baeb-2d4f4d5e4eca None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:06.761257 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c275dd3-695e-4b11-8da6-e446a3c2b94a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:06.761942 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c275dd3-695e-4b11-8da6-e446a3c2b94a service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:06.762236 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c275dd3-695e-4b11-8da6-e446a3c2b94a service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:06.762543 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c275dd3-695e-4b11-8da6-e446a3c2b94a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:06.773684 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c275dd3-695e-4b11-8da6-e446a3c2b94a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:06.775140 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c275dd3-695e-4b11-8da6-e446a3c2b94a service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:06.785957 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1432/2905] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:10.590603 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.664670 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10493a-fc74-489a-aa8a-8bb6433912ea service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.669439 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.670835 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.671312 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.671686 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] PATH_INFO: `/v3/users/4894a53c331f49e3a2391c707135c3c5` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.672937 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4894a53c331f49e3a2391c707135c3c5)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.674907 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.730915 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4894a53c331f49e3a2391c707135c3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.738582 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4894a53c331f49e3a2391c707135c3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.739213 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4894a53c331f49e3a2391c707135c3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.751594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4894a53c331f49e3a2391c707135c3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.752231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4894a53c331f49e3a2391c707135c3c5'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.765282 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1474/2906] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:10 2022] DELETE /identity/v3/users/4894a53c331f49e3a2391c707135c3c5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:10.769791 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.770262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.770372 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.787550 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:10.788679 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:10.847314 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1433/2907] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:10.859291 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.861982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:10.908728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:10.932283 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb4d55-cb8e-4dc0-82fd-1aac501e5216 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.936669 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.937325 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.937631 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.937906 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.947608 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.949038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.959838 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1475/2908] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:11.225624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:11.227063 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:11.239954 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a196e-8db2-459b-943d-3bfc04dcd889 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:11.244716 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:11.245606 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:11.245891 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:11.246163 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] PATH_INFO: `/v3/projects/c30f458a703c4d2b9fbcab4f296cf4b7` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:11.247361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30f458a703c4d2b9fbcab4f296cf4b7)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:11.250128 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:11.296648 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:11.297959 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30f458a703c4d2b9fbcab4f296cf4b7', 'request_id': 'req-69f14f0d-f58a-4525-bb9a-727decfa007b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.305194 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30f458a703c4d2b9fbcab4f296cf4b7', 'request_id': 'req-69f14f0d-f58a-4525-bb9a-727decfa007b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.311742 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30f458a703c4d2b9fbcab4f296cf4b7', 'request_id': 'req-69f14f0d-f58a-4525-bb9a-727decfa007b'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.322978 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] The token cache is being invalidate because project c30f458a703c4d2b9fbcab4f296cf4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:11.323294 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.323936 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.325792 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1434/2909] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:11 2022] DELETE /identity/v3/projects/c30f458a703c4d2b9fbcab4f296cf4b7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:11.330057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:11.339920 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c231317-3bcc-4446-955d-3ea512ee90a1 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:11.403588 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:11.404464 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:11.405451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:11.405876 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] PATH_INFO: `/v3/users/ce3994de4e7347a7b86a6b1b2af81f8c` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:11.407196 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3994de4e7347a7b86a6b1b2af81f8c)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:11.409127 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:11.455842 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3994de4e7347a7b86a6b1b2af81f8c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.463114 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3994de4e7347a7b86a6b1b2af81f8c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.463728 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3994de4e7347a7b86a6b1b2af81f8c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.476207 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3994de4e7347a7b86a6b1b2af81f8c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.476839 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-3e2011f7-5ae4-4be8-b8a7-19afc649a1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3994de4e7347a7b86a6b1b2af81f8c'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.489035 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1476/2910] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:11 2022] DELETE /identity/v3/users/ce3994de4e7347a7b86a6b1b2af81f8c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:28:11.770499 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:11.771922 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:11.785643 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f14f0d-f58a-4525-bb9a-727decfa007b admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:11.844248 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:11.845037 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:11.845314 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:11.845616 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] PATH_INFO: `/v3/projects/5b6ae1e44a314f6a9249984ed9674e02` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:11.846794 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6ae1e44a314f6a9249984ed9674e02)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:11.848695 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:11.900749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6ae1e44a314f6a9249984ed9674e02', 'request_id': 'req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.908890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6ae1e44a314f6a9249984ed9674e02', 'request_id': 'req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.914563 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6ae1e44a314f6a9249984ed9674e02', 'request_id': 'req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.925887 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] The token cache is being invalidate because project 5b6ae1e44a314f6a9249984ed9674e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:11.926173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.926804 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-1a365cdf-2c71-4d3d-8e31-0d2fef5dbdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:11.928344 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1435/2911] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:11 2022] DELETE /identity/v3/projects/5b6ae1e44a314f6a9249984ed9674e02 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:11.933169 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48648-c70f-46b8-95ff-d1dcd8876d5d None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:11.933680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48648-c70f-46b8-95ff-d1dcd8876d5d None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:11.933778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd48648-c70f-46b8-95ff-d1dcd8876d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:11.953315 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-abd48648-c70f-46b8-95ff-d1dcd8876d5d None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:11.954559 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-abd48648-c70f-46b8-95ff-d1dcd8876d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:12.004450 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:12.015858 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1477/2912] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:12.023633 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414b211-3f7a-4b13-b57f-693e86c076f3 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.023927 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414b211-3f7a-4b13-b57f-693e86c076f3 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.024210 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414b211-3f7a-4b13-b57f-693e86c076f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.042966 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-6414b211-3f7a-4b13-b57f-693e86c076f3 None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:12.044173 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-6414b211-3f7a-4b13-b57f-693e86c076f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:12.052377 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1436/2913] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:12.056487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48648-c70f-46b8-95ff-d1dcd8876d5d None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.066592 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd48648-c70f-46b8-95ff-d1dcd8876d5d None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.071131 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.071777 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.072054 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.072327 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] PATH_INFO: `/v3/domains` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.073039 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80134) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:12.073338 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.075284 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.087778 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1478/2914] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:28:12.092800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414b211-3f7a-4b13-b57f-693e86c076f3 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.104361 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414b211-3f7a-4b13-b57f-693e86c076f3 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.111418 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.112111 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.112399 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.112672 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.113386 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.115284 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.144170 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1437/2915] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:12 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:12.145432 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.156294 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9b95f-3d8c-4b4b-bd7d-6722c6d1b45d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.211947 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.212610 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.212892 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.213168 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.213982 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.215895 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.237371 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1479/2916] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:12 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:12.241697 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.252917 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313990d-c4fe-4b80-a6a8-a12172e1ca0e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.257540 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.258206 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.258521 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.258800 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.259532 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.261133 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.272151 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1438/2917] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:12.276066 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.286077 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a434835-9075-4af9-b316-2e1bcb6206de admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.290673 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f94848-94f7-4118-b9be-c1b6c30111df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.291330 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f94848-94f7-4118-b9be-c1b6c30111df admin admin] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.291616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f94848-94f7-4118-b9be-c1b6c30111df admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.291898 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f94848-94f7-4118-b9be-c1b6c30111df admin admin] PATH_INFO: `/v3/roles` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.292627 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f94848-94f7-4118-b9be-c1b6c30111df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.294259 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f94848-94f7-4118-b9be-c1b6c30111df admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.304038 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1480/2918] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:12.307990 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.318745 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a451-5997-4a06-9922-fbb5e89b5855 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.323427 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.324537 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.324823 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.325103 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] PATH_INFO: `/v3/projects/665b4836e1cb4ba4b007d784e7360005/users/8f46b8700d5a4e2aa93c6cb2a18a8a09/roles/4335b2432ea84f658c748de9ac9026d1` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.340530 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=665b4836e1cb4ba4b007d784e7360005, user_id=8f46b8700d5a4e2aa93c6cb2a18a8a09, role_id=4335b2432ea84f658c748de9ac9026d1)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.343525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.359871 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1439/2919] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:12 2022] PUT /identity/v3/projects/665b4836e1cb4ba4b007d784e7360005/users/8f46b8700d5a4e2aa93c6cb2a18a8a09/roles/4335b2432ea84f658c748de9ac9026d1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:12.372491 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b30a51-231a-467b-9bf2-36a2fe31dccf None None] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.372780 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b30a51-231a-467b-9bf2-36a2fe31dccf None None] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.373060 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b30a51-231a-467b-9bf2-36a2fe31dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.404143 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.auth.core [None req-92b30a51-231a-467b-9bf2-36a2fe31dccf None None] MFA Rules not processed for user `8f46b8700d5a4e2aa93c6cb2a18a8a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80134) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:12.405734 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-92b30a51-231a-467b-9bf2-36a2fe31dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:12.470731 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1481/2920] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:12.475212 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.479666 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:12.546000 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6e4ab-54a2-4ebf-bac8-00e333b9a2d7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.550775 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.551443 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.551728 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.552007 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.552707 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.554644 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.580749 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1440/2921] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:12 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:12.584617 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b30a51-231a-467b-9bf2-36a2fe31dccf None None] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.595826 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b30a51-231a-467b-9bf2-36a2fe31dccf None None] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.644435 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:12.654543 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.655831 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] REQUEST_METHOD: `POST` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.656113 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.656390 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] PATH_INFO: `/v3/users` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.657087 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.659057 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.678815 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1482/2922] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:12 2022] POST /identity/v3/users => generated 307 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:12.682890 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.693118 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab4c36-7527-4629-ae4f-913ee0de10fc admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.697730 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.698388 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.698670 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.698946 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.699963 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.702125 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.712463 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1441/2923] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:12.716531 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.727344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b143ff-518e-4feb-9442-e41069a6fc1d admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.731950 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.732860 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.733378 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.733680 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] PATH_INFO: `/v3/projects/b9537dbeed5442349ebc16c19c851159/users/5207c867ce1b4cf2a45984b338ecc0a3/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.749927 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9537dbeed5442349ebc16c19c851159, user_id=5207c867ce1b4cf2a45984b338ecc0a3, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.752649 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.767281 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1483/2924] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:12 2022] PUT /identity/v3/projects/b9537dbeed5442349ebc16c19c851159/users/5207c867ce1b4cf2a45984b338ecc0a3/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:12.771292 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.782095 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d1fd2-86d7-4bab-83fb-8b60d717259e admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.838413 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cd3d9-3509-4883-aa8e-af92e2347da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.839074 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cd3d9-3509-4883-aa8e-af92e2347da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.839354 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cd3d9-3509-4883-aa8e-af92e2347da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.839628 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cd3d9-3509-4883-aa8e-af92e2347da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.840348 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cd3d9-3509-4883-aa8e-af92e2347da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.841968 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cd3d9-3509-4883-aa8e-af92e2347da4 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.852440 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1442/2925] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:12.856868 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:12.867344 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3f8b6-a170-446c-a006-acddc88571d5 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:12.872068 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:12.872967 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] REQUEST_METHOD: `PUT` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.873248 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.873547 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] PATH_INFO: `/v3/projects/b9537dbeed5442349ebc16c19c851159/users/5207c867ce1b4cf2a45984b338ecc0a3/roles/12c8bb015e454a52a54bf61032d11091` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.875840 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9537dbeed5442349ebc16c19c851159, user_id=5207c867ce1b4cf2a45984b338ecc0a3, role_id=12c8bb015e454a52a54bf61032d11091)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:12.878487 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:12.889757 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1484/2926] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:12 2022] PUT /identity/v3/projects/b9537dbeed5442349ebc16c19c851159/users/5207c867ce1b4cf2a45984b338ecc0a3/roles/12c8bb015e454a52a54bf61032d11091 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:12.899846 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd789-27c7-410c-b21c-c25ced66f8a4 None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:12.900073 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd789-27c7-410c-b21c-c25ced66f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:12.900356 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfd789-27c7-410c-b21c-c25ced66f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:12.927238 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-a2dfd789-27c7-410c-b21c-c25ced66f8a4 None None] MFA Rules not processed for user `5207c867ce1b4cf2a45984b338ecc0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:12.928462 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-a2dfd789-27c7-410c-b21c-c25ced66f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:12.991739 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:12.998147 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1443/2927] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:13.008979 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:13.010718 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:13.067616 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491960f-34a4-44b7-976d-ecaccb278cca admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:13.071308 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:13.071942 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:13.072231 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:13.072507 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:13.082814 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:13.084253 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:13.094272 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1485/2928] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:13.167624 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfd789-27c7-410c-b21c-c25ced66f8a4 None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:13.177815 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfd789-27c7-410c-b21c-c25ced66f8a4 None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:13.181476 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d676627-42dd-4b7f-8f17-ff1389517205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae320f14f9e4422aa99f91fe730cdd2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:13.182121 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676627-42dd-4b7f-8f17-ff1389517205 service cinder] REQUEST_METHOD: `GET` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:13.182525 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676627-42dd-4b7f-8f17-ff1389517205 service cinder] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:13.183027 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d676627-42dd-4b7f-8f17-ff1389517205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:13.241171 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676627-42dd-4b7f-8f17-ff1389517205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:13.242938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d676627-42dd-4b7f-8f17-ff1389517205 service cinder] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:13.252660 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1444/2929] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:13 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:17.453310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.515008 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b218f68-61e3-4684-a5a6-2b4baba9dcb4 service cinder] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.519457 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.520310 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.521215 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.521597 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] PATH_INFO: `/v3/users/8f46b8700d5a4e2aa93c6cb2a18a8a09` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.522756 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f46b8700d5a4e2aa93c6cb2a18a8a09)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.524647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.570214 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f46b8700d5a4e2aa93c6cb2a18a8a09'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:17.572704 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:17.578217 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f46b8700d5a4e2aa93c6cb2a18a8a09'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:17.579279 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f46b8700d5a4e2aa93c6cb2a18a8a09'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:17.591991 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f46b8700d5a4e2aa93c6cb2a18a8a09'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:17.592634 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f46b8700d5a4e2aa93c6cb2a18a8a09'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:17.605232 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1486/2930] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:17 2022] DELETE /identity/v3/users/8f46b8700d5a4e2aa93c6cb2a18a8a09 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:17.609810 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] REQUEST_METHOD: `POST` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.610302 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.610478 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.628184 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.auth.core [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] MFA Rules not processed for user `fb50bdfd467346e58d39bc41efeb3f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80135) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:17.629319 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:17.689042 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1445/2931] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:17.699666 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.701048 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:17.757675 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aaa7a-2640-47b4-a144-7f89af7cb5e2 admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.761298 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b28926500a14cd3aa74c59f60e076c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.761990 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.762273 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.762551 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.771647 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.773108 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.782646 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1487/2932] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:18.052910 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:18.054375 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:18.068637 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c80c29-6d58-4871-97b9-d2322cb13dff None None] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:18.073307 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:18.075218 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:18.075507 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:18.075765 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] PATH_INFO: `/v3/projects/665b4836e1cb4ba4b007d784e7360005` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:18.077059 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665b4836e1cb4ba4b007d784e7360005)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:18.079020 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:18.127938 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665b4836e1cb4ba4b007d784e7360005', 'request_id': 'req-cd41c50c-f746-469a-9e41-97efb962a8b7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.136070 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665b4836e1cb4ba4b007d784e7360005', 'request_id': 'req-cd41c50c-f746-469a-9e41-97efb962a8b7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.141591 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665b4836e1cb4ba4b007d784e7360005', 'request_id': 'req-cd41c50c-f746-469a-9e41-97efb962a8b7'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.153309 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] The token cache is being invalidate because project 665b4836e1cb4ba4b007d784e7360005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:18.153625 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.154262 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.155855 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1446/2933] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:18 2022] DELETE /identity/v3/projects/665b4836e1cb4ba4b007d784e7360005 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:18.159845 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:18.170133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ccf3-87d1-446a-89fb-2763ceec6880 service neutron] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:18.225594 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:18.226451 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:18.226738 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:18.227011 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] PATH_INFO: `/v3/users/5207c867ce1b4cf2a45984b338ecc0a3` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:18.228183 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5207c867ce1b4cf2a45984b338ecc0a3)` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:18.230133 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:18.274539 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5207c867ce1b4cf2a45984b338ecc0a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.280958 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5207c867ce1b4cf2a45984b338ecc0a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.281663 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5207c867ce1b4cf2a45984b338ecc0a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.294280 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5207c867ce1b4cf2a45984b338ecc0a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.294909 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.notifications [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5207c867ce1b4cf2a45984b338ecc0a3'} {{(pid=80134) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.296078 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:18.309252 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1488/2934] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:18 2022] DELETE /identity/v3/users/5207c867ce1b4cf2a45984b338ecc0a3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:18.586607 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Authenticating user token {{(pid=80135) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:18.588101 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.fernet_utils [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80135) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:18.603673 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41c50c-f746-469a-9e41-97efb962a8b7 admin admin] Validating token access rules against request {{(pid=80135) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:18.622780 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:18.665918 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb50bdfd467346e58d39bc41efeb3f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4af5872a8c47a1a7622f9d72a65eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80135) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:18.666704 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:18.666988 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:18.667265 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] PATH_INFO: `/v3/projects/b9537dbeed5442349ebc16c19c851159` {{(pid=80135) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:18.668439 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9537dbeed5442349ebc16c19c851159)` {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:18.670383 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] RBAC: Authorization granted {{(pid=80135) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:18.716680 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9537dbeed5442349ebc16c19c851159', 'request_id': 'req-239bee69-d13e-4bfd-b7e9-5177926c5419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.724350 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9537dbeed5442349ebc16c19c851159', 'request_id': 'req-239bee69-d13e-4bfd-b7e9-5177926c5419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.729907 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9537dbeed5442349ebc16c19c851159', 'request_id': 'req-239bee69-d13e-4bfd-b7e9-5177926c5419'} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.741618 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] The token cache is being invalidate because project b9537dbeed5442349ebc16c19c851159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80135) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:18.741926 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.742555 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG keystone.notifications [None req-239bee69-d13e-4bfd-b7e9-5177926c5419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80135) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:18.744088 dv-cinder-849846-1-smb devstack@keystone.service[80135]: [pid: 80135|app: 0|req: 1447/2935] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:18 2022] DELETE /identity/v3/projects/b9537dbeed5442349ebc16c19c851159 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:28.305729 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=5 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:28.737993 dv-cinder-849846-1-smb devstack@keystone.service[80135]: DEBUG dbcounter [-] [80135] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:01.498469 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Authenticating user token {{(pid=80134) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:32:01.499953 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:01.569268 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468180a1-4746-4f37-84dd-b78d4932c13c admin admin] Validating token access rules against request {{(pid=80134) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:32:01.629140 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b494f59-db3d-4af0-ac89-9ed7ffe1d5ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecddc5e9b4e140ff817284acb38d9801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7577656601f14550ab40539deaaa67e1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80134) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:32:01.630001 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494f59-db3d-4af0-ac89-9ed7ffe1d5ae service placement] REQUEST_METHOD: `GET` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:32:01.630512 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494f59-db3d-4af0-ac89-9ed7ffe1d5ae service placement] SCRIPT_NAME: `/identity` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:32:01.631022 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494f59-db3d-4af0-ac89-9ed7ffe1d5ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80134) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:32:01.633394 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.fernet_utils [None req-2b494f59-db3d-4af0-ac89-9ed7ffe1d5ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80134) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:01.647489 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b494f59-db3d-4af0-ac89-9ed7ffe1d5ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:32:01.649081 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b494f59-db3d-4af0-ac89-9ed7ffe1d5ae service placement] RBAC: Authorization granted {{(pid=80134) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:32:01.659300 dv-cinder-849846-1-smb devstack@keystone.service[80134]: [pid: 80134|app: 0|req: 1489/2936] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:32:11.654954 dv-cinder-849846-1-smb devstack@keystone.service[80134]: DEBUG dbcounter [-] [80134] Writing DB stats keystone:SELECT=58 {{(pid=80134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}